Title of Invention

A COMPUTER SYSTEM

Abstract An apparatus for providing real-time context intelligence of automatically recognized key words/phrases, for hands free searches or simple and more complex databases, characterized by: user interface and display means (4,6,8,10) for both inputting speech and data and outputting visual and speech responses is operatively connected to ah interface' means (12) which, in turn being connected to an intelligence system means (14), recognizes the user input and passes recognized inputs to said intelligence system means (14) and supplies output signals to said user interface and display means (4,6,8,10), said intelligence system means (14) correlates the recognized user input with the context of the operation being performed by user (2) and sends output signals to said user interface and display means (4,6,8,10).
Full Text FORM 2
THE PATENTS ACT, 1970
[39 OF 1970]
&
THE PATENTS RULES, 2003
COMPLETE SPECIFICATION
[See Section 10; rule 13] "A COMPUTER SYSTEM"
We, BAE SYSTEMS PLC of 6 Carlton Gardens, London SWIY 5AD, United Kingdom,
The following specification particularly describes the invention and the manner in which is to be performed:-

16-11-2007

GRANTED





An apparatus for providing real-time context intelligence of automatically recognized key words/phrases, for hands free searches of simple and more complex databases.
State of the art applications and database interrogation methods usually comprise the use of trained operators utilizing menu driven interface systems to retrieve the required data or information on demand. Such systems typically require the operator to have knowledge of the access requirements of a number of databases and in most cases further constrains the operator to using and having access to only one such database at a time.
In areas such as Telephone Call Centres, typically used by companies for customer query and complaint processing, trained operators are required to ask predetermined questions of the callers to enable them to then manually access whichever particular database is required, in order to identify such features as part numbers, makes and/or models for use in processing the query or complaint For example, a typically call centre operator may be required to respond to customer requests for information over a range of differing company products, namely telephones, washing machines, televisions, audio equipment etc. The operator would therefore have to quickly establish which particular type of product the caller is referring to following by the make, model number, serial number and possibly date of purchase, these types of information most probably being stored on more than one database. The requirement to switch between a range of databases using a keyboard

and/or mouse and conduct a conversation using a predetermined set of closely worded questions can be an arduous task for a call centre operator and our invention would significantly reduce the operator work load and call time per transaction.

Numerous other applications where access to a range of databases is required which currently use manual operator access may include logistics and support, physical security and tasks such as those performed by ships' captains when steering vessels, pilots and airborne engineers.
European Patent Application No. 92119615.0 discloses a speech dialogue system for facilitating human-computer interaction. This speech dialogue based invention, although having a human-computer interaction role, does not perform the function of assisting a human operator in his or her tasks but is designed to replace a human operator. The invention allows a human to speak to a machine, and through a speech recognition system a response to input speech is formulated and an output made according to the understood semantic content of the input speech. The understanding of a semantic content of an input speech from the user is made by detecting keywords in the input speed with the keywords in the input speed being limited in advance in accordance with the needs of the overall system.
The speech dialogue system therefore assists a customer by replacing a human operator and not by supporting an operator throughout a series of transactions. Our invention utilizes a human computer interface system and an intelligence system which enables real time analysis of operator and/or customer inputs (keyboard, mouse, speech etc.) and provides a reasoning facility designed specifically to support an operator by navigating a "rich" data domain (one or more databases) in response to contextual keywords and phrases provided by a automatic speech recognition system.
Our invention provides apparatus and a method of providing real-time context intelligence of automatically recognized key words/phrases, foTuseln handslree searches of simple and more complex databases.

Additionally it provides a flexible and powerful approach to improving current Call Centre Software support by integrating a fully functional Human Computer Interface (HCI)System with an Intelligent system and allowing these to be further integrated with an existing software Application.

Accordingly there is provided a human-computer interface system, comprising user interface and display means for both inputting speech and data and outputting visual and speech responses, human-computer interface means for recognition of a user input and subsequent passing of recognized inputs to an intelligence systems means, and for supplying output signals to the user interface and display means, intelligence system means for correlating the recognized user input with the context of the operation being performed by the user, based on an intelligent assessment of the context of the user operation, and based on such assessment, sending output signals to the user interface and display means which may comprise information or data retrieved from an applications or database.
According to another aspect of the invention there is provided a method a method of providing real time context intelligence in relation to automatically recognized input signals whereby information and/or data inputted from a user interface and display means is recognized by a human-computer interface means such that it can be passed to an intelligence system means whereby the recognized user input data and information is correlated with the context of the operation being performed by the user, and based on an intelligent assessment of the context of the user operation, output signals are sent back' to the user interface and display means, said output signals capable of comprising information or data retrieved from applications or database.

Other features and advantages of the invention will become apparent from the following description taken in conjunction with the accompanying drawings.
The invention is illustrated in figures 1 to 3 by way of example only in which:
Figure 1 shows a diagrammatic representation of a typical system in accordance with the invention;
Figure 2 shows a diagrammatic representation of an HCI System,
and;
Figure 3 shows a diagrammatic representation of an Intelligent System in accordance with the invention.
In Figure 1, a user or operator 2 is depicted as having a range of interface devices at his or her disposal, namely a display for the pointing device/keyboard 6, a microphone 8 and a speaker 10. All of the above devices (namely 4, 6, 8, 10) are connected to a human computer interface system 12 which in turn is linked to an intelligence system 14 which has access to a range of applications and/or databases 16. Whilst in use, the overall system as depicted in Figure 1 enables the user or operator 2 to use any of the available input devices, (i.e. pointing device/keyboard 6 and microphone 8) to access applications and/or databases 16 through the HCI system 12 and the intelligence system 14. The function of the HCI system 12 and intelligence system 14 is essentially to "eavesdrop" on a conversation or data exchange between the user or operator 2 and either another person or persons (not shown) or another data outputting system (not shown).

The HCI System as shown at Figure 2 consists of integrated voice recognition 18, speech synthesis 20 and display functions 22. This allows the recognized voice phrases to amend the displayed information 24 (e.g. presenting a help window) as well as being forwarded to the Intelligent System 14 to allow it to monitor and if required change the context under which it is operating. Standard interactions via the pointing device and or the keyboard 6 are also forwarded to the Intelligent System for inclusion in the overall decision making, intelligent process.
The messages from the Intelligent System 14 can trigger display changes 24 (e.g. presenting the next set of prompt questions) and can also trigger speech synthesis 26 (e.g. a telephone number could be relayed). In some cases the message from the Intelligent System 14 can trigger both display changes 24 and speech synthesis 26.
Figure 3 shows the activities that are carried out by the Intelligent System 14 as shown in Figures 1 and 2. Firstly, the Intelligent system 14 correlates the input data in the Input Correlation module from the user/operator's 2 display 4 and microphone input 8 to identify the subject matter of the user/operator's 2 input. Following this, the current state in the conversation/interaction is used to determine the context of the operator's input in the context recognition module 30. Once the subject has been identified and the context is known, the actions that are required to derive the data that is of use to the operator are determined. This may involve querying one or more databases 32, performing calculations, analyzing trades, looking up case histories, etc. Once the actions have been completed and the data has been obtained, it is then presented to the operator in a suitable manner, either textually by for example a printer (not shown) graphically, via a form of display 4, sonically via a speaker 8, or some combination of all of these. Additionally, the current status of the conversation/interaction needs to

be updated in order to provide the proper context for further operator inputs. The intelligent System therefore continually monitors all of the inputs made through the HCI such that when the input correlation 28 and content recognition modules 30 detect a change in user/operator 2 requirements, then the system can respond by accessing the newly required databases 32 and/or performing the necessary calculations.
Potential applications of the invention are numerous, and extend to any user/operator based system where access to, and navigation around a 'rich' data domain, i.e. one or more databases is required.
Examples of applications may include air traffic control operators, whereby the use of the invention would provide for the real time monitoring of incoming speech and data, the system responding to speech or data inputs in an intelligent manner by assessing the context of the current operators work and providing access to differing databases, display screens or other information when required but not necessarily with direct request.
Other examples may include use by pilots to manage onboard systems, weapon systems' operators, ships' captains and call centre operators.

WE CLAIM :
1. An apparatus for providing real-time context intelligence of
automatically recognized key words/phrases, for hands free
searches or simple and more complex databases, characterized
by:
user interface and display means (4,6,8,10) for both inputting speech and data and outputting visual and speech responses is operatively connected to ah interface' means (12) which, in turn being connected to an intelligence system means (14), recognizes the user input and passes recognized inputs to said intelligence system means (14) and supplies output signals to said user interface and display means (4,6,8,10), said intelligence system means (14) correlates the recognized user input with the context of the operation being performed by user (2) and sends output signals to said user interface and display means (4,6,8,10).
2. The apparatus as claimed in claim 1, wherein said interface
means (12) has an integrated voice recognition means (18),
speech synthesis (20) and display function means (22).
Dated this 11th day of July, 2000.
[SANJA KUMAR]
OF REMFRY & SAGAR
ATTORNEY FOR-THE APPLICANTS

Documents:

abstract1.jpg

in-pct-2000-00173-mum-assignment(16-11-2007).pdf

in-pct-2000-00173-mum-cancelled pages(16-11-2007).pdf

in-pct-2000-00173-mum-claims(granted)-(16-11-2007).doc

in-pct-2000-00173-mum-claims(granted)-(16-11-2007).pdf

in-pct-2000-00173-mum-correspondence(16-11-2007).pdf

in-pct-2000-00173-mum-correspondence(ipo)-(24-10-2008).pdf

in-pct-2000-00173-mum-drawing(16-11-2007).pdf

in-pct-2000-00173-mum-form 1(11-07-2000).pdf

in-pct-2000-00173-mum-form 13(08-08-2007).pdf

in-pct-2000-00173-mum-form 1a(08-08-2007).pdf

in-pct-2000-00173-mum-form 1a(11-07-2000).pdf

in-pct-2000-00173-mum-form 1a(16-11-2007).pdf

in-pct-2000-00173-mum-form 1a(21-04-2004).pdf

in-pct-2000-00173-mum-form 1a(23-03-2004).pdf

in-pct-2000-00173-mum-form 2(granted)-(16-11-2007).doc

in-pct-2000-00173-mum-form 2(granted)-(16-11-2007).pdf

in-pct-2000-00173-mum-form 3(08-08-2003).pdf

in-pct-2000-00173-mum-form 3(11-07-2000).pdf

in-pct-2000-00173-mum-form 5(11-07-2000).pdf

in-pct-2000-00173-mum-form 6(16-11-2007).pdf

in-pct-2000-00173-mum-form-pct-ipea-409(16-11-2007).pdf

in-pct-2000-00173-mum-form-pct-isa-210(16-11-2007).pdf

in-pct-2000-00173-mum-petition under rule 137(08-08-2003).pdf

in-pct-2000-00173-mum-petition under rule 138(08-08-2003).pdf

in-pct-2000-00173-mum-power of authority(08-08-2003).pdf

in-pct-2000-00173-mum-power of authority(16-11-2007).pdf

in-pct-2000-00173-mum-power of authority(23-03-2004).pdf

in-pct-2000-00173-mum-power of authority(26-05-2004).pdf


Patent Number 224929
Indian Patent Application Number IN/PCT/2000/00173/MUM
PG Journal Number 02/2009
Publication Date 09-Jan-2009
Grant Date 24-Oct-2008
Date of Filing 11-Jul-2000
Name of Patentee BAE SYSTEMS PLC
Applicant Address 6 CARLTON GARDENS, LONDON SW1Y 5AD, UNITED KINGDOM.
Inventors:
# Inventor's Name Inventor's Address
1 ARCHIBALD MACAULAY BAE SEMA LIMITED, APEX TOWER, 7 HIGH STREET, NEW MALDEN, SURREY, KT3 4LH, UNITED KINGDOM
PCT International Classification Number G 06 F 17/30
PCT International Application Number PCT/GB99/00112
PCT International Filing date 1999-01-13
PCT Conventions:
# PCT Application Number Date of Convention Priority Country
1 9800590.3 1998-01-13 GB