Source: https://patents.google.com/patent/US9384578B2/en
Timestamp: 2018-11-17 07:30:34
Document Index: 184454430

Matched Legal Cases: ['Application No. 201180020353', 'Application No. 201180020353', 'Application No. 2012', 'Application No. 2012', 'Application No. 2012', 'Application No. 201180020353', 'Application No. 2012', 'Application No. 201180020353', 'Application No. 201180020353']

US9384578B2 - Augmented reality design system - Google Patents
US9384578B2
US9384578B2 US14571443 US201414571443A US9384578B2 US 9384578 B2 US9384578 B2 US 9384578B2 US 14571443 US14571443 US 14571443 US 201414571443 A US201414571443 A US 201414571443A US 9384578 B2 US9384578 B2 US 9384578B2
US14571443
US20150109322A1 (en )
This application is a continuation of Friesen, U.S. application Ser. No. 12/709,636, entitled “Augmented Reality Design System”, filed on Feb. 22, 2010, published as U.S. Patent Publication Number 2011/0205242, which is hereby incorporated by reference in its entirety.
In some embodiments, a design system could be used for designing various physical and/or functional components including, but not limited to: straps, heel counters, toe caps, outsoles, midsoles, laces, as well as other functional components for an article. For example, in one embodiment, a user could design an outsole for a sole by drawing a traction pattern on the bottom surface of a proxy. In another example, a user could draw a strap onto a portion of a proxy. As another example, a user could draw one or more inserts that may be utilized with one or more portions of an article. Examples of straps and inserts that could be designed using an augmented reality design system can be found in Gerber, U.S. Patent Application Publication Number 2010/0180469 (now U.S. patent application Ser. No. 12/358,234) directed to an Article of Footwear with a Customizable Upper; the entirety of which is hereby incorporated by reference.
1. A method of designing an article, comprising the steps of:
viewing a proxy for the article on a display device, the proxy existing in a real-world environment, the proxy having a three-dimensional irregular shape, the proxy including sensors disposed in the proxy that are configured to detect interactions between portions of the proxy with an interacting device, and wherein a portion of the proxy, as viewed on the display device, has a first color;
wherein the sensors disposed in the proxy substantially cover any surface of the proxy to be interacted with the interacting device;
viewing, on the display device, a virtual menu in a location in the real-world environment;
physically placing the interacting device in the location to select a color from a color palette, wherein the placing the interacting device in the location has been detected by an imaging device;
contacting the portion of the proxy in the real-world environment with the interacting device at a contact point, wherein the contacting has been detected by a sensor of the sensors disposed in the proxy; and
viewing, during the step of contacting, the proxy on the display device, wherein the portion of the proxy, as viewed on the display device, has a second color that is different from the first color, and wherein the portion has been displayed, by the display device, as the second color based on the contacting being detected by the sensor of the sensors disposed in the proxy and based on the physically placing the interacting device in the location being detected by the imaging device.
2. The method according to claim 1, wherein the step of viewing during the step of contacting comprises a step of displaying a virtual design element at a location on the proxy corresponding to the portion of the proxy; and
wherein the virtual design element has the second color.
3. The method according to claim 1, wherein the proxy has the approximate shape of a human body.
4. The method according to claim 3, wherein the article is an article of clothing.
5. The method according to claim 3, wherein the article is a hat.
6. The method according to claim 1, wherein the article is an article of footwear.
7. A method of designing an article, comprising the steps of:
selecting a color from a virtual color palette associated with a proxy for the article, the selecting the color from the virtual color palette having been detected by an imaging device, the proxy existing in a real-world environment and having a first color, the proxy having a three-dimensional irregular shape, and the proxy including sensors disposed in the proxy that are configured to detect interactions between portions of the proxy with an interacting device, wherein a portion of the proxy has a first color;
contacting the portion of a proxy in the real-world environment with the interacting device at a contact point, wherein the contacting has been detected by a sensor of the sensors disposed in the proxy; and
viewing a projection of a second color on the portion of the proxy including the contact point substantially immediately after the interacting device has contacted the portion of the proxy in the real-world environment, wherein the second color is different from the first color, and wherein the projection of the second color has been based on the contacting being detected by the sensor of the sensors disposed in the proxy and based on the selected color from the virtual color palette being detected by the imaging device.
8. The method according to claim 7, wherein the proxy has the approximate shape of a foot.
9. The method according to claim 8, wherein the article is an article of footwear.
10. The method according to claim 7, wherein the interacting device is a stylus.
11. The method according to claim 7, wherein the article is an article of clothing.
12. The method according to claim 7, wherein the portion of the proxy corresponds to an upper of an article of footwear.
13. An augmented reality design system for designing an article, comprising:
a proxy for the article existing in the real world environment, the proxy having a three dimensional irregular shape;
an interacting device for interacting with the proxy in the real world environment, wherein sensors disposed in the proxy are configured to detect interactions between portions of the proxy with the interacting device;
a computing device capable of generating virtual images, at least one of the virtual images being based on at least one detection of a contact point by a sensor of the sensors disposed in the proxy;
a display device, wherein the at least one virtual image is superimposed onto an image, received by the imaging device, of the proxy;
a virtual menu that may be displayed on the display device, wherein the virtual menu is associated with a location in the real world environment and wherein a user can interact with the virtual menu by placing the interacting device in the location and wherein the interaction with the virtual menu is detected by the imaging device;
wherein the sensors disposed in the proxy detect the location on the proxy corresponding with the contact point of the interacting device with a surface of the proxy in the real-world environment.
14. The design system according to claim 13, wherein the virtual menu includes a color palette.
15. The design system according to claim 13, wherein the virtual menu includes a drawing tool.
16. The design system according to claim 13, wherein the virtual menu includes a letter tool.
17. The design system according to claim 13, wherein the virtual menu includes a virtual graphic.
18. The design system according to claim 13, wherein the virtual menu includes an eraser tool.
19. The design system according to claim 13, wherein the virtual menu includes a selection tool.
20. An augmented reality design system for designing an article, comprising:
a proxy for the article existing in a real world environment, the proxy having a three dimensional irregular shape;
a projecting device, wherein the at least one virtual image is projected onto the proxy;
a virtual menu that may be projected onto a location in the real-world environment, wherein a user can interact with the virtual menu by placing the interacting device in the location and wherein the interaction with the virtual menu is detected by the imaging device;
wherein the sensors disposed in the proxy detect the location on the proxy corresponding with the contact point of the interacting device with a surface of the proxy in the real world environment.
21. The design system according to claim 20, wherein the virtual design element is a virtual line.
22. The design system according to claim 20, wherein the virtual design element corresponds to a color.
23. The design system according to claim 20, wherein the virtual design element is a virtual graphic.
US14571443 2010-02-22 2014-12-16 Augmented reality design system Active US9384578B2 (en)
US12709636 Continuation US8947455B2 (en) 2010-02-22 2010-02-22 Augmented reality design system
US15074154 Continuation US9858724B2 (en) 2010-02-22 2016-03-18 Augmented reality design system
US20150109322A1 true US20150109322A1 (en) 2015-04-23
US9384578B2 true US9384578B2 (en) 2016-07-05
Chinese Office Action dated Dec. 29, 2014 of Chinese Application No. 201180020353.2 with English translation.
Chinese Office Action dated Jun. 3, 2015 of Chinese Application No. 201180020353.2 with English translation.
Decision of Rejection in Japanese Patent Application No. 2012-554019 dated Dec. 2, 2014, and English translation thereof.
Notice of Appeal as filed Apr. 1, 2015 for Japanese Patent Application No. 2012-554019, and the English translation thereof.
Office Action dated Jan. 21, 2014 in JP Patent Application No. 2012-554019.
Office Action mailed Nov. 5, 2015 for Chinese Patent Application No. 201180020353.2.
Raphael Grasset, et al., "Interactive Mediated Reality", AUIC'05 Proceedings of the Sixth Australasian Conference, Jan. 30, 2005; pp. 21-29.
Response filed Jul. 18, 2014 in Japanese Patent Application No. 2012-554019, and English translation thereof.
Response filed May 13, 2015 in Chinese Patent Application No. 201180020353.2, and English translation thereof.
Response to Office Action as filed Oct. 19, 2015 for Chinese Patent Application No. 201180020353.2, and the English translation thereof.