Source: http://www.google.com/patents/US7499686?dq=6,219,045
Timestamp: 2014-07-13 16:02:11
Document Index: 169885735

Matched Legal Cases: ['Application No. 05107921', 'Application No. 05108871', 'application No. 166473', 'Application No. 04016226', 'application No. 04025457', 'application No. 05101071', 'Application No. 121']

Patent US7499686 - Method and apparatus for multi-sensory speech enhancement on a mobile device - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign in<nobr>Advanced Patent Search</nobr>PatentsA mobile device is provided that includes a digit input that can be manipulated by a user's fingers or thumb, an air conduction microphone and an alternative sensor that provides an alternative sensor signal indicative of speech. Under some embodiments, the mobile device also includes a proximity sensor...http://www.google.com/patents/US7499686?utm_source=gb-gplus-sharePatent US7499686 - Method and apparatus for multi-sensory speech enhancement on a mobile deviceAdvanced Patent SearchPublication numberUS7499686 B2Publication typeGrantApplication numberUS 10/785,768Publication dateMar 3, 2009Filing dateFeb 24, 2004Priority dateFeb 24, 2004Fee statusPaidAlso published asCA2494637A1, CA2494637C, CN1662018A, CN100583909C, CN101510905A, CN101510905B, EP1569422A2, EP1569422A3, US20050185813Publication number10785768, 785768, US 7499686 B2, US 7499686B2, US-B2-7499686, US7499686 B2, US7499686B2InventorsMichael J. Sinclair, Xuedong David Huang, Zhengyou ZhangOriginal AssigneeMicrosoft CorporationExport CitationBiBTeX, EndNote, RefManPatent Citations (104), Non-Patent Citations (33), Referenced by (17), Classifications (24), Legal Events (2) External Links: USPTO, USPTO Assignment, EspacenetMethod and apparatus for multi-sensory speech enhancement on a mobile deviceUS 7499686 B2Abstract A mobile device is provided that includes a digit input that can be manipulated by a user's fingers or thumb, an air conduction microphone and an alternative sensor that provides an alternative sensor signal indicative of speech. Under some embodiments, the mobile device also includes a proximity sensor that provides a proximity signal indicative of the distance from the mobile device to an object. Under some embodiments, the signal from the air conduction microphone, the alternative sensor signal, and the proximity signal are used to form an estimate of a clean speech value. In further embodiments, a sound is produced through a speaker in the mobile device based on the amount of noise in the clean speech value. In other embodiments, the sound produced through the speaker is based on the proximity sensor signal.
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS3383466May 28, 1964May 14, 1968Navy UsaNonacoustic measures in automatic speech recognitionUS3746789Oct 20, 1971Jul 17, 1973Alcivar ETissue conduction microphone utilized to activate a voice operated switchUS3787641Jun 5, 1972Jan 22, 1974Setcom CorpBone conduction microphone assemblyUS4382164Oct 30, 1980May 3, 1983Bell Telephone Laboratories, IncorporatedSignal stretcher for envelope generatorUS4769845Apr 6, 1987Sep 6, 1988Kabushiki Kaisha CarrylabMethod of recognizing speech using a lip imageUS5054079Jan 25, 1990Oct 1, 1991Stanton Magnetics, Inc.Bone conduction microphone with mounting meansUS5151944Sep 21, 1989Sep 29, 1992Matsushita Electric Industrial Co., Ltd.Headrest and mobile body equipped with sameUS5197091Nov 19, 1990Mar 23, 1993Fujitsu LimitedPortable telephone having a pipe member which supports a microphoneUS5295193Jan 22, 1992Mar 15, 1994Hiroshi OnoDevice for picking up bone-conducted sound in external auditory meatus and communication device using the sameUS5404577Jun 18, 1991Apr 4, 1995Cairns & Brother Inc.Combination head-protective helmet & communications systemUS5446789Feb 17, 1995Aug 29, 1995International Business Machines CorporationElectronic device having antenna for receiving soundwavesUS5555449Mar 7, 1995Sep 10, 1996Ericsson Inc.Extendible antenna and microphone for portable communication unitUS5590241Apr 30, 1993Dec 31, 1996Motorola Inc.Speech processing system and method for enhancing a speech signal in a noisy environmentUS5647834Jun 30, 1995Jul 15, 1997Ron; SamuelSpeech-based biofeedback method and systemUS5692059Feb 24, 1995Nov 25, 1997Kruger; Frederick M.Two active element in-the-ear microphone systemUS5701390Feb 22, 1995Dec 23, 1997Digital Voice Systems, Inc.Synthesis of MBE-based coded speech using regenerated phase informationUS5757934Apr 4, 1996May 26, 1998Yokoi Plan Co., Ltd.Transmitting/receiving apparatus and communication system using the sameUS5812970Jun 24, 1996Sep 22, 1998Sony CorporationMethod based on pitch-strength for reducing noise in predetermined subbands of a speech signalUS5828768May 11, 1994Oct 27, 1998Noise Cancellation Technologies, Inc.Multimedia personal computer with active noise reduction and piezo speakersUS5873728Mar 20, 1996Feb 23, 1999Samsung Electronics Co., Ltd.Sound pronunciation comparing method in sound signal reproducing apparatusUS5933506May 16, 1995Aug 3, 1999Nippon Telegraph And Telephone CorporationTransmitter-receiver having ear-piece type acoustic transducing partUS5943627Feb 18, 1997Aug 24, 1999Kim; Seong-SooMobile cellular phoneUS5983073Apr 4, 1997Nov 9, 1999Ditzik; Richard J.Modular notebook and PDA computer systems for personal computing and wireless communicationsUS5983186Aug 20, 1996Nov 9, 1999Seiko Epson CorporationVoice-activated interactive speech recognition device and methodUS6006175Feb 6, 1996Dec 21, 1999The Regents Of The University Of CaliforniaMethods and apparatus for non-acoustic speech characterization and recognitionUS6028556Dec 16, 1998Feb 22, 2000Shicoh Engineering Company, Ltd.Portable radio communication apparatusUS6052464May 29, 1998Apr 18, 2000Motorola, Inc.Telephone set having a microphone for receiving or an earpiece for generating an acoustic signal via a keypadUS6052567Jan 7, 1998Apr 18, 2000Sony CorporationPortable radio apparatus with coaxial antenna feeder in microphone armUS6091972Jan 23, 1998Jul 18, 2000Sony CorporationMobile communication unitUS6094492May 10, 1999Jul 25, 2000Boesen; Peter V.Bone conduction voice transmission apparatus and systemUS6125284Mar 6, 1995Sep 26, 2000Cable & Wireless PlcCommunication system with handset for distributed processingUS6137883May 30, 1998Oct 24, 2000Motorola, Inc.Telephone set having a microphone for receiving an acoustic signal via keypadUS6151397May 16, 1997Nov 21, 2000Motorola, Inc.Method and system for reducing undesired signals in a communication environmentUS6175633Apr 9, 1997Jan 16, 2001Cavcom, Inc.Radio communications apparatus with attenuating ear pieces for high noise environmentsUS6243596Feb 3, 1998Jun 5, 2001Lextron Systems, Inc.Method and apparatus for modifying and integrating a cellular phone with the capability to access and browse the internetUS6266422Jan 29, 1998Jul 24, 2001Nec CorporationNoise canceling method and apparatus for the sameUS6292674 *Aug 5, 1998Sep 18, 2001Ericsson, Inc.One-handed control for wireless telephoneUS6308062Mar 6, 1997Oct 23, 2001Ericsson Business Networks AbWireless telephony system enabling access to PC based functionalitiesUS6339706Nov 12, 1999Jan 15, 2002Telefonaktiebolaget L M Ericsson (Publ)Wireless voice-activated remote control deviceUS6343269May 27, 1999Jan 29, 2002Fuji Xerox Co., Ltd.Speech detection apparatus in which standard pattern is adopted in accordance with speech modeUS6377919Nov 4, 1999Apr 23, 2002The Regents Of The University Of CaliforniaSystem and method for characterizing voiced excitations of speech and acoustic signals, removing acoustic noise from speech, and synthesizing speechUS6389391 *Apr 2, 1996May 14, 2002Mitsubishi Denki Kabushiki KaishaVoice coding and decoding in mobile communication equipmentUS6408081Jun 5, 2000Jun 18, 2002Peter V. BoesenBone conduction voice transmission apparatus and systemUS6411933Nov 22, 1999Jun 25, 2002International Business Machines CorporationMethods and apparatus for correlating biometric attributes and biometric attribute production featuresUS6434239Oct 3, 1997Aug 13, 2002Deluca Michael JosephAnti-sound beam method and apparatusUS6542721May 1, 2001Apr 1, 2003Peter V. BoesenCellular telephone, personal digital assistant and pager unitUS6560468Oct 11, 1999May 6, 2003Peter V. BoesenCellular telephone, personal digital assistant, and pager unit with capability of short range radio frequency transmissionsUS6590651May 19, 1999Jul 8, 2003Spectrx, Inc.Apparatus and method for determining tissue characteristicsUS6594629Aug 6, 1999Jul 15, 2003International Business Machines CorporationMethods and apparatus for audio-visual speech detection and recognitionUS6664713Dec 4, 2001Dec 16, 2003Peter V. BoesenSingle chip device for voice communicationsUS6675027Nov 22, 1999Jan 6, 2004Microsoft CorpPersonal mobile computing device having antenna microphone for improved speech recognitionUS6707921Nov 26, 2001Mar 16, 2004Hewlett-Packard Development Company, Lp.Use of mouth position and mouth movement to filter noise from speech in a hearing aidUS6717991Jan 28, 2000Apr 6, 2004Telefonaktiebolaget Lm Ericsson (Publ)System and method for dual microphone signal noise reduction using spectral subtractionUS6738485Nov 7, 2000May 18, 2004Peter V. BoesenApparatus, method and system for ultra short range communicationUS6754358 *Jul 10, 2001Jun 22, 2004Peter V. BoesenMethod and apparatus for bone sensingUS6760600Jan 27, 1999Jul 6, 2004Gateway, Inc.Portable communication apparatusUS6959276Sep 27, 2001Oct 25, 2005Microsoft CorporationIncluding the category of environmental noise when processing speech signalsUS7054423May 23, 2002May 30, 2006Nebiker Robert MMulti-media communication downloadingUS7110944Jul 27, 2005Sep 19, 2006Siemens Corporate Research, Inc.Method and apparatus for noise filteringUS7117148Apr 5, 2002Oct 3, 2006Microsoft CorporationMethod of noise reduction using correction vectors based on dynamic aspects of speech and noise normalizationUS7181390Jul 26, 2005Feb 20, 2007Microsoft CorporationNoise reduction using correction vectors based on dynamic aspects of speech and noise normalizationUS7190797 *Jun 18, 2002Mar 13, 2007Plantronics, Inc.Headset with foldable noise canceling and omnidirectional dual-mode boomUS20010027121May 1, 2001Oct 4, 2001Boesen Peter V.Cellular telephone, personal digital assistant and pager unitUS20010039195Jan 27, 1999Nov 8, 2001Larry NickumPortable communication apparatusUS20010044318 *Dec 14, 2000Nov 22, 2001Nokia Mobile Phones Ltd.Controlling a terminal of a communication systemUS20020057810Jan 9, 2002May 16, 2002Boesen Peter V.Computer and voice communication unit with handsfree deviceUS20020068537 *Dec 4, 2000Jun 6, 2002Mobigence, Inc.Automatic speaker volume and microphone gain control in a portable handheld radiotelephone with proximity sensorsUS20020075306Dec 18, 2000Jun 20, 2002Christopher ThompsonMethod and system for initiating communications with dispersed team members from within a virtual team environment using personal identifiersUS20020114472Mar 15, 2001Aug 22, 2002Lee Soo YoungMethod for active noise cancellation using independent component analysisUS20020118852Apr 29, 2002Aug 29, 2002Boesen Peter V.Voice communication deviceUS20020173953Mar 20, 2001Nov 21, 2002Frey Brendan J.Method and apparatus for removing noise from feature vectorsUS20020181669Sep 27, 2001Dec 5, 2002Sunao TakatoriTelephone device and translation telephone deviceUS20020196955Sep 5, 2002Dec 26, 2002Boesen Peter V.Voice transmission apparatus with UWBUS20020198021Jun 21, 2001Dec 26, 2002Boesen Peter V.Cellular telephone, personal digital assistant with dual lines for simultaneous usesUS20030061037Sep 27, 2001Mar 27, 2003Droppo James G.Method and apparatus for identifying noise environments from noisy signalsUS20030083112Oct 30, 2002May 1, 2003Mikio FukudaTransceiver adapted for mounting upon a strap of facepiece or headgearUS20030097254Nov 5, 2002May 22, 2003The Regents Of The University Of CaliforniaUltra-narrow bandwidth voice codingUS20030125081Feb 18, 2003Jul 3, 2003Boesen Peter V.Cellular telephone and personal digital assistantUS20030144844Jan 30, 2002Jul 31, 2003Koninklijke Philips Electronics N.V.Automatic speech recognition system and methodUS20030179888Mar 5, 2003Sep 25, 2003Burnett Gregory C.Voice activity detection (VAD) devices and methods for use with noise suppression systemsUS20040028154Aug 4, 2003Feb 12, 2004Intel CorporatonChannel estimatorUS20040086137Nov 1, 2002May 6, 2004Zhuliang YuAdaptive control system for noise cancellationUS20040092297Oct 31, 2003May 13, 2004Microsoft CorporationPersonal mobile computing device having antenna microphone and speech detection for improved speech recognitionUS20040186710Mar 21, 2003Sep 23, 2004Rongzhen YangPrecision piecewise polynomial approximation for Ephraim-Malah filterUS20040249633Jan 30, 2004Dec 9, 2004Alexander AsseilyAcoustic vibration sensorUS20050038659Nov 26, 2002Feb 17, 2005Marc HelbingMethod of operating a barge-in dialogue systemUS20050114124Nov 26, 2003May 26, 2005Microsoft CorporationMethod and apparatus for multi-sensory speech enhancementUS20060008256Sep 29, 2004Jan 12, 2006Khedouri Robert KAudio visual player apparatus and system and method of content distribution using the sameUS20060009156Jun 22, 2004Jan 12, 2006Hayes Gerard JMethod and apparatus for improved mobile station and hearing aid compatibilityUS20060072767Sep 17, 2004Apr 6, 2006Microsoft CorporationMethod and apparatus for multi-sensory speech enhancementUS20060079291Oct 12, 2004Apr 13, 2006Microsoft CorporationMethod and apparatus for multi-sensory speech enhancement on a mobile deviceUSH1497Jul 6, -7he United States of America as represented by the Secretary of the Air ForceDUAL-CHANNEL COLLECTION AND USE OF SPEECH CORRECTION SIGNALS RIGHTS OF THE GOVERNMENTDE19917169A1Apr 16, 1999Nov 2, 2000Kamecke Keller OrlaVideo data recording and reproduction method for portable radio equipment, such as personal stereo with cartridge playback device, uses compression methods for application with portable deviceEP0720338A2Dec 18, 1995Jul 3, 1996International Business Machines CorporationTelephone-computer terminal portable unitEP0742678A2May 1, 1996Nov 13, 1996AT&amp;T Corp.Noise canceling gradient microphone assemblyEP0854535A2Jan 16, 1998Jul 22, 1998Sony CorporationAntenna apparatusEP0939534A1Feb 24, 1999Sep 1, 1999Nec CorporationMethod for recognizing speech on a mobile terminalEP0951883A2Mar 11, 1999Oct 27, 1999Nippon Telegraph and Telephone CorporationWearable communication device with bone conduction transducerEP1333650A2Jan 31, 2003Aug 6, 2003Nokia CorporationMethod of enabling user access to servicesEP1569422A2Feb 14, 2005Aug 31, 2005Microsoft CorporationMethod and apparatus for multi-sensory speech enhancement on a mobile deviceFR2761800A1 Title not availableGB2375276A Title not availableGB2390264A Title not availableJPH03108997A Title not available* Cited by examinerNon-Patent CitationsReference1"Physiological Monitoring System 'Lifeguard' System Specifications," Stanford University Medical Center, National Biocomputation Center, Nov. 8, 2002.2An Office Action in foreign application No. PA/a/2005/002133 filed Feb. 23, 2005.3Asada, H. and Barbagelata, M., "Wireless Fingernail Sensor for Continuous Long Term Health Monitoring," MIT Home Automation and Healthcare Consortium, Phase 3, Progress Report No. 3-1, Apr. 2001.4Australian Search Report and Written Opinion for Foreign Application No. SG 200500289-4 filed Jan. 18, 2005.5Baker, "The Insight of Wireless Communication," Research and Development, 2002, Student Conference on Jul. 16-17, 2002.6De Cuetos P. et al. "Audio-visual intent-to-speak detection for human-computer interaction" vol. 6, Jun. 5, 2000. pp. 2373-2376.7European Search Report from Application No. 05107921.8, filed Aug. 30, 2005.8European Search Report from Application No. 05108871.4, filed Sep. 26, 2005.9http://www.3G.co.uk, "NTT DoCoMo to Introduce First Wireless GPS Handset," Mar. 27, 2003.10http://www.misumi.com.tw/PLIST.ASP?PC.ID:21 (2004).11http://www.snaptrack.com/ (2004).12http://www.wherifywireless.com/prod.watches.htm (2001).13http://www.wherifywireless.com/univLoc.asp (2001).14Israeli Examination Report in foreign application No. 166473, filed Feb. 24, 2004.15Kumar, V., "The Design and Testing of a Personal Health System to Motivate Adherence to Intensive Diabetes Management," Harvard-MIT Division of Health Sciences and Technology, pp. 1-66, 2004.16M. Graciarena, H. Franco, K. Sonmez, and H. Bratt, "Combining Standard and Throat Microphones for Robust Speech Recognition," IEEE Signal Processing Letters, vol. 10, No. 3, pp. 72-74, Mar. 2003.17Microsoft Office, Live Communications Server 2003, Microsoft Corporation, pp. 1-10, 2003.18Nagl, L., "Wearable Sensor System for Wireless State-of-Health Determination in Cattle;" Annual International Conference of the Institute of Electrical and Electronics Engineers Engineering in Medicine and Biology Society, 2003.19O.M. Strand, T. Holter, A. Egeberg, and S. Stensby, "On the Feasibility of ASR in Extreme Noise Using the PARAT Earplug Communication Terminal," ASRU 2003, St. Thomas, U.S. Virgin Islands, Nov. 20-Dec. 4, 2003.20P. Heracleous, Y. Nakajima, A. Lee, H. Saruwatari, K. Shikano, "Accurate Hidden Markov Models for Non-Audible Murmur (NAM) Recognition Based on Iterative Supervised Adaptation," ASRU 2003, St. Thomas, U.S. Virgin Islands, Nov. 20-Dec. 4, 2003.21RD 418033, Feb. 10, 1999.22Search Report dated Dec. 17, 2004 from International Application No. 04016226.5.23Shoshana Berger, http://www.cnn.com/technology, "Wireless, wearable, and wondrous tech," Jan. 17, 2003.24The European Search Report from foreign application No. 04025457.5 filed Oct. 26, 2004.25The European Search Report from foreign application No. 05101071.8 filed Feb. 14, 2005.26The Office Action from Foreign Application No. 121-2005, filed Jan. 21, 2005.27The Written Opinion from Foreign Application No. SG 200500289-4, filed Jan. 18, 2005.28U.S. Appl. No. 10/629,278, filed Jul. 29, 2003, Huang et al.29U.S. Appl. No. 10/636,176, filed Aug. 7, 2003, Huang et al.30U.S. Appl. No. 10/724,008, filed Nov. 26, 2003, Zicheng et al.31U.S. Appl. No. 11/156,434, filed Jun. 20, 2005, Zicheng et al.32Z. Zhang, Z. Liu, M. Sinclair, A. Acero, L. Deng, J. Droppo, X. D. Huang, Y. Zheng, "Multi-Sensory Microphones For Robust Speech Detection, Enchantment, and Recognition," ICASSP 04, Montreal, May 17-21, 2004.33Zheng Y. et al., "Air and Bone-Conductive Integrated Microphones for Robust Speech Detection and Enhancement" Automatic Speech Recognition and Understanding 2003. pp. 249-254.Referenced byCiting PatentFiling datePublication dateApplicantTitleUS7734247 *Jan 25, 2007Jun 8, 2010Sony Ericsson Mobile Communications AbConfigurable serial memory interfaceUS7925502 *Apr 19, 2007Apr 12, 2011Microsoft CorporationPitch model for noise estimationUS7983720May 24, 2005Jul 19, 2011Broadcom CorporationWireless telephone with adaptive microphone arrayUS8068620 *Feb 28, 2008Nov 29, 2011Canon Kabushiki KaishaAudio processing apparatusUS8139787 *Sep 8, 2006Mar 20, 2012Simon HaykinMethod and device for binaural signal enhancementUS8160263 *May 31, 2006Apr 17, 2012Agere Systems Inc.Noise reduction by mobile communication devices in non-call situationsUS8180636Mar 7, 2011May 15, 2012Microsoft CorporationPitch model for noise estimationUS8428661Oct 30, 2007Apr 23, 2013Broadcom CorporationSpeech intelligibility in telephones with multiple microphonesUS8509703Aug 31, 2005Aug 13, 2013Broadcom CorporationWireless telephone with multiple microphones and multiple description transmissionUS8594750 *Jan 2, 2013Nov 26, 2013Blackberry LimitedMobile wireless communications device having improved antenna impedance match and antenna gain from RF energyUS8631358Nov 8, 2007Jan 14, 2014Apple Inc.Variable device graphical user interfaceUS8676224 *Feb 19, 2008Mar 18, 2014Apple Inc.Speakerphone control for mobile deviceUS8731923 *Aug 20, 2010May 20, 2014Adacel Systems, Inc.System and method for merging audio data streams for use in speech recognition applicationsUS20090209293 *Feb 19, 2008Aug 20, 2009Apple Inc.Speakerphone Control for Mobile DeviceUS20120046946 *Aug 20, 2010Feb 23, 2012Adacel Systems, Inc.System and method for merging audio data streams for use in speech recognition applicationsUS20130130754 *Jan 2, 2013May 23, 2013Research In Motion LimitedMobile wireless communications device having improved antenna impedance match and antenna gain from rf energyWO2011159349A1 *Jun 14, 2011Dec 22, 2011Audiotoniq, Inc.Hearing aid system* Cited by examinerClassifications U.S. Classification455/223, 704/260, 379/392.01, 455/114.2, 455/570, 381/375, 455/283International ClassificationH04M1/60, H04B1/10, H04M1/03, H04R1/00, G10L21/02, H04R1/02Cooperative ClassificationH04M2250/12, H04M1/6008, G10L21/0208, H04R3/005, H04R2460/13, H04M1/6016, H04M1/605European ClassificationH04R3/00B, G10L21/0208, H04M1/60T2A, H04M1/60MLegal EventsDateCodeEventDescriptionAug 28, 2012FPAYFee paymentYear of fee payment: 4Feb 24, 2004ASAssignmentOwner name: MICROSOFT CORPORATION, WASHINGTONFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SINCLAIR, MICHAEL J.;HUANG, XUEDONG DAVID;ZHANG, ZHENGYOU;REEL/FRAME:015023/0494;SIGNING DATES FROM 20040221 TO 20040223RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services©2012 Google