Source: https://patents.google.com/patent/US10286299B2/en
Timestamp: 2019-12-11 22:28:05
Document Index: 554059307

Matched Legal Cases: ['Application No. 61', 'Application No. 14', 'Application No. 2016', 'Application No. 17169562', 'Application No. 201480039341', 'Application No. 2017', 'Application No. 2016']

US10286299B2 - Transitioning gameplay on a head-mounted display - Google Patents
US10286299B2
US10286299B2 US15/859,630 US201715859630A US10286299B2 US 10286299 B2 US10286299 B2 US 10286299B2 US 201715859630 A US201715859630 A US 201715859630A US 10286299 B2 US10286299 B2 US 10286299B2
US15/859,630
US20180147483A1 (en
2017-12-31 Application filed by Sony Interactive Entertainment Inc filed Critical Sony Interactive Entertainment Inc
2017-12-31 Priority to US15/859,630 priority patent/US10286299B2/en
2018-05-31 Publication of US20180147483A1 publication Critical patent/US20180147483A1/en
2019-05-14 Publication of US10286299B2 publication Critical patent/US10286299B2/en
This application claims priority as a continuation of U.S. application Ser. No. 14/231,609, filed Mar. 31, 2014, entitled “TRANSITIONING GAMEPLAY ON A HEAD-MOUNTED DISPLAY,” which claims priority to U.S. Provisional Application No. 61/832,762, filed Jun. 7, 2013, entitled “TRANSITIONING GAMEPLAY ON A HEAD-MOUNTED DISPLAY,” the disclosure of which is incorporated by reference herein.
presenting gameplay of a video game through a head-mounted display, the head-mounted display being disposed in a local environment;
detecting a person speaking in the local environment, wherein detecting the person speaking includes capturing audio from the local environment by the head-mounted display, and analyzing the captured audio to identify the person speaking in the local environment;
responsive to detecting the person speaking in the local environment, presenting a notification through the head-mounted display, the notification providing an option to pause the gameplay of the video game;
responsive to receiving a command indicating selection of the option, pausing the gameplay of the video game and presenting through the head-mounted display a view provided through an externally facing camera of the head-mounted display that enables viewing of the person speaking in the local environment.
2. The method of claim 1, wherein detecting the person speaking in the local environment includes applying voice recognition to the captured audio to determine an identity of the person speaking in the local environment.
3. The method of claim 1, wherein detecting the person speaking in the local environment includes applying sound localization to the captured audio to determine a location of the person speaking in the local environment.
4. The method of claim 3, wherein presenting the view through the externally facing camera of the head-mounted display is defined to open from a direction that is towards the location of the person speaking in the local environment.
5. The method of claim 1, wherein detecting the person speaking in the local environment includes capturing images by the externally facing camera of the head-mounted display and analyzing the captured images to identify the person speaking in the local environment.
6. The method of claim 5, wherein detecting the person speaking in the local environment includes applying image recognition to the captured images to determine an identity of the person speaking in the local environment.
7. The method of claim 5, wherein detecting the person speaking in the local environment includes analyzing the captured images to determine a location of the person speaking in the local environment.
8. The method of claim 7, wherein presenting the view through the externally facing camera of the head-mounted display is defined to open from a direction that is towards the location of the person speaking in the local environment.
9. The method of claim 1, wherein pausing the gameplay of the video game includes identifying an intensity of a gameplay aspect, and progressively reducing the intensity of the gameplay aspect before entering a paused state.
11. The method of claim 10, wherein a location of the virtual element in a virtual space defines a view of the virtual space presented on the head-mounted display, the view of the virtual space changing in accordance with the velocity of the virtual element.
13. The method of claim 9, wherein the intensity of the gameplay aspect is defined by a complexity of graphics presented on the head-mounted display; and
wherein progressively reducing the intensity of the gameplay aspect includes progressively simplifying the graphics presented on the head-mounted display, wherein simplifying the graphics includes removing one or more visual elements from a scene.
in response to receiving the signal to resume gameplay, transitioning the gameplay from the paused state to an active state;
15. The method of claim 14, wherein transitioning the gameplay from the paused state to the active state includes identifying a first gameplay timepoint earlier than a second gameplay timepoint at which the gameplay was paused, and initiating the transitioning from the paused state to the active state from the first gameplay timepoint.
detecting a person speaking in the local environment, wherein detecting the person speaking includes capturing audio from the local environment by the head-mounted display, capturing images by an externally facing camera of the head-mounted display, and analyzing the captured audio and the captured images to identify the person speaking in the local environment;
responsive to receiving a command indicating selection of the option, pausing the gameplay of the video game and presenting through the head-mounted display a view provided through the externally facing camera of the head-mounted display that enables viewing of the person speaking in the local environment.
17. The method of claim 16, wherein detecting the person speaking in the local environment includes applying voice recognition to the captured audio and/or applying image recognition to the captured images to determine an identity of the person speaking in the local environment.
18. The method of claim 16, wherein detecting the person speaking in the local environment includes applying sound localization to the captured audio and/or analyzing the captured images to determine a location of the person speaking in the local environment.
19. The method of claim 18, wherein presenting the view through the externally facing camera of the head-mounted display is defined to open from a direction that is towards the location of the person speaking in the local environment.
20. The method of claim 16, wherein pausing the gameplay of the video game includes identifying an intensity of a gameplay aspect, and progressively reducing the intensity of the gameplay aspect before entering a paused state.
US15/859,630 2013-06-07 2017-12-31 Transitioning gameplay on a head-mounted display Active US10286299B2 (en)
US14/231,609 Continuation US9878235B2 (en) 2013-06-07 2014-03-31 Transitioning gameplay on a head-mounted display
US16/412,377 Continuation US20190314719A1 (en) 2013-06-07 2019-05-14 Transitioning gameplay on a head-mounted display
US20180147483A1 US20180147483A1 (en) 2018-05-31
US10286299B2 true US10286299B2 (en) 2019-05-14
EP (2) EP3003515B1 (en)
CN106997241A (en) * 2016-01-22 2017-08-01 宏达国际电子股份有限公司 The method and virtual reality system interactive with real world in reality environment
EP3318835A4 (en) * 2016-09-13 2019-02-27 Bagel Labs Co., Ltd. Length measurement device and control method therefor
JPH1085450A (en) 1996-09-19 1998-04-07 Namco Ltd Attraction game system
JPH11161814A (en) 1997-11-25 1999-06-18 Namco Ltd Image generation device, simulation device and information storage medium
JP2000339490A (en) 1999-05-28 2000-12-08 Mitsubishi Electric Corp Vr sickness reducing method
US20080114645A1 (en) 2006-11-09 2008-05-15 Sony Computer Entertainment America Inc. Advertisement scheme for use with interactive content
CN101627622A (en) 2007-01-09 2010-01-13 斯卡拉株式会社 Head-mounted display
JP3712478B2 (en) * 1996-09-30 2005-11-02 株式会社ナムコ Method of controlling a game apparatus and a game apparatus
2017-08-30 JP JP2017165796A patent/JP2018029968A/en active Pending
CN101595504A (en) 2006-11-09 2009-12-02 索尼计算机娱乐美国公司 Advertisement scheme for use with interactive content
JP2010509873A (en) 2006-11-09 2010-03-25 ソニー・コンピュータ・エンタテインメント・アメリカ・インク Advertising schemes used with interactive content
Communication pursuant to Article 94(3) EPC, issued in related European Patent Application No. 14 736 171.1-1906, dated Mar. 21, 2017 (5 pages).
Decision of Refusal, issued in related Japanese Patent Application No. 2016-518054, dated May 30, 2017 (8 total pages).
Extended European Search Report (EESR) issued in European Application No. 17169562.0-1906, dated Aug. 30, 2017 (9 pages).
F. STEINICKE ; G. BRUDER ; K. HINRICHS ; A. STEED ; A.L. GERLACH: "Does a Gradual Transition to the Virtual World increase Presence?", VIRTUAL REALITY CONFERENCE, 2009. VR 2009. IEEE, IEEE, PISCATAWAY, NJ, USA, 14 March 2009 (2009-03-14), Piscataway, NJ, USA, pages 203 - 210, XP031465473, ISBN: 978-1-4244-3943-0
First Office Action issued in corresponding Chinese Patent Application No. 201480039341.8, dated Jun. 29, 2018, with Eng. translation (20 total pages).
Invitation to Pay Additional Fees and, Where Applicable, Protest Fee (Form PCT/ISA/206), issued in Int'l Application No. PCT/US2014/041422, dated Oct. 14, 2014 (4 pages).
Notification of Reason(s) for Refusal issued in corresponding Japanese Patent Application No. 2017-165796, dated Jul. 31, 2018, with Eng. translation (9 total pages).
Notification of Reason(s) for Refusal, issued in related Japanese Patent Application No. 2016-518054, dated Jan. 10, 2016 (9 total pages).
Steinicke, Frank et al., "Does a Gradual Transition to the Virtual World Increase Presence?," Virtual Reality Conf, 2009. IEEE, Lafayette, Louisiana, USA, Mar. 14, 2009, pp. 203-210 (XP031465473), ISBN: 978-1-4244-3943-0.