Source: https://patents.google.com/patent/US9628766B2/en
Timestamp: 2020-02-19 19:58:55
Document Index: 400958404

Matched Legal Cases: ['§371', 'art 1402', 'art 1003', 'art 1003', 'art 1002', 'art 1001', 'art 1402', 'art 2701', 'art 1001', 'art\n1002', 'art\n1003', 'art\n1401', 'Application No. 201280069909', 'Application No. 2014500879', 'Application No. 2014500879', 'Application No. 12869246']

US9628766B2 - Display device, image processing device and image processing method, and computer program - Google Patents
US9628766B2
US9628766B2 US14/378,840 US201214378840A US9628766B2 US 9628766 B2 US9628766 B2 US 9628766B2 US 201214378840 A US201214378840 A US 201214378840A US 9628766 B2 US9628766 B2 US 9628766B2
US14/378,840
US20150009416A1 (en
Akira FUJINAWA
2012-02-22 Priority to JP2012-036407 priority Critical
2012-02-22 Priority to JP2012036407 priority
2012-12-17 Priority to PCT/JP2012/082620 priority patent/WO2013125138A1/en
2014-08-15 Assigned to SONY CORPORATION reassignment SONY CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SHIMIZU, MASAYUKI, FUJINAWA, Akira, IKEDA, KIYOSHI, TAMAYAMA, KEN
2015-01-08 Publication of US20150009416A1 publication Critical patent/US20150009416A1/en
2017-04-18 Publication of US9628766B2 publication Critical patent/US9628766B2/en
238000003702 image correction Methods 0 abstract claims description 53
The present application is a national phase entry under 35 U.S.C. §371 of International Application No. PCT/JP2012/082620 filed Dec. 17, 2012, published on Aug. 29, 2013 as WO 2013/125138A1, which claims priority from Japanese Patent Application No. JP 2012-036407, filed in the Japanese Patent Office on Feb. 22, 2012.
The present application takes the above-described problems into consideration. According to the present technology, there is provided a display device including an image display unit configured to display an image with a plurality of pixels arranged on a display surface, an eyepiece optical unit configured to project the display surface of the image display unit in a manner that a predetermined angle of view is obtained, and an image correction unit configured to correct a display image on the display surface at a position of each of representative pixels which are discretely located on the display surface, on the basis of distortion generated due to the eyepiece optical unit.
A computer program according to the technology of the present application defines a computer program described in a computer-readable form such that a predetermined process is achieved on a computer. In other words, a cooperative operation is exerted on the computer by installing in the computer the computer program according to the technology of the present application so as to be able to obtain an operation effect similar to the display device described above of the present application.
In the case of the pin-cushion distortion, the angle of view is b′/b as shown in FIG. 3. As shown in a formula (1) below, since Db>0 holds, the angle of view is widened.
[ Math ⁢ ⁢ 1 ] D b = 100 × b ′ - b b ⁢ ⁢ b ′ b = 1 + D b 100 ( 1 )
On the other hand, in the case of the barrel distortion, the angle of view is a′/a as shown in FIG. 5. As shown in a formula (2) below, since Da<0 holds, the angle of view is narrowed.
[ Math ⁢ ⁢ 2 ] D a = 100 × a ′ - a a ⁢ ⁢ a ′ a = 1 + D a 100 ( 2 )
The signal process as used herein corresponds to a process of giving, to a presented image, distortion in a direction opposite to the distortion generated in the projection image of an eyepiece optical system. FIG. 2 shows a functional block diagram illustrating correction by the signal process of the distortion which is generated in the projection image of the eyepiece optical system in the head-mount display. An HDMI reception unit 201 receives the presented image from an image source such as the Blu-ray disc reproduction device 20. An image correction unit 202 gives distortion in a direction opposite to the distortion generated in the eyepiece optical system 204 to the presented image. A display unit 203 includes organic EL elements and the like and displays on the screen the presented image having been corrected by the image correction unit 202 with the distortion in the opposite direction. The display image on the screen is projected to a retina of an observer′ eye through the eyepiece optical system 204. When a light of the display image passes through the eyepiece optical system 204, the distortion is generated, in the direction opposite to which distortion the display image is given the distortion, and thus, a normal virtual image with no distortion is formed on the retina.
For example, in the case where the pin-cushion distortion as shown in FIG. 3 is generated in the eyepiece optical system, the image correction unit 202 performs the signal process of giving distortion in a direction opposite to the pin-cushion distortion, that is, the image correction unit 202 enlarges the presented image at the center of a visual field and reduces toward the end to distorted in a barrel shape and displayed as shown in FIG. 4, and thereby, can eliminate the pin-cushion distortion from the projection image of the eyepiece optical system. At the center of the visual field, b′/b times (see formula (1) above) enlargement is performed. In FIG. 4, a pixel displayed at a point r2 on the display screen is taken from a point r3 in a post-correction visual field (see formula (3) below). The point r3 in the post-correction visual field corresponds to a point r1 on an original image in association with the enlargement of the visual field (see formula (4) below). A pixel displayed at the point r2 on the display screen is taken from the point r1 on the original image (see formula (5) below). Here, a distortion rate at the point r2 is Dr according to the enlargement of the visual field.
[ Math ⁢ ⁢ 3 ] r 3 = ( 1 + D r 100 ) ⁢ r 2 ( 3 ) [ Math ⁢ ⁢ 4 ] r 3 = ( 1 + D b 100 ) ⁢ r 1 ( 4 ) [ Math ⁢ ⁢ 5 ] r 1 = 100 + D r 100 + D b ⁢ r 2 ( 5 )
In the case where the barrel distortion as show in FIG. 5 is generated in the eyepiece optical system, the image correction unit 202 performs the signal process of giving distortion opposite to the barrel distortion. That is, the image correction unit 202, with the four corners of the original image being set as fixed points, reduces toward the visual field center to distort the presented image in a pin-cushion shape to be displayed as shown in FIG. 6, and thereby, can eliminate the barrel distortion from the projection image of the eyepiece optical system. At the center of the visual field, a′/a times (see formula (2) above) reduction is performed. In FIG. 6, a pixel displayed at the point r2 on the display screen is taken from a point r3 in the post-correction visual field (see formula (6) below). The point r3 in the post-correction visual field corresponds to the point r1 on the original image visual field in association with the enlargement (see formula (7) below). A pixel displayed at the point r2 on the display screen is taken from the point r1 on the original image (see formula (8) below). Here, the distortion rate at the point r2 is Dr according to the enlargement of the visual field.
[ Math ⁢ ⁢ 6 ] r 3 = ( 1 + D r 100 ) ⁢ r 2 ( 6 ) [ Math ⁢ ⁢ 7 ] r 3 = ( 1 + D a 100 ) ⁢ r 1 ( 7 ) [ Math ⁢ ⁢ 8 ] r 1 = 100 + D r 100 + D a ⁢ r 2 ( 8 )
FIG. 7 schematically shows a correction model by the image correction unit 202. Assume below that input signal coordinates of the presented image input to the HDMI reception unit 201 are p′ (x′, y′), and display pixel coordinates of the display image on the screen of the display unit 203 are p (x, y). Physical coordinates on the screen of the display unit 203 using the lens as a reference are P (X, Y) and physical coordinates on a surface of the virtual image which is formed by projecting the screen of the display unit 203 by the eyepiece optical system 204 using the lens as a reference are P′ (X′, Y′).
Between the display pixel coordinates p (x, y) of the display image on the screen of the display unit 203 and the physical coordinate P (X, Y) on the screen of the display unit 203 using the lens of the eyepiece optical system 204 as a reference, there exist a difference in pixel pitch and a position gap in fixing the display unit 202 at a certain site in the head-mount unit 10. Between the physical coordinate P (X, Y) on the screen of the display unit 203 and a physical image P′ (X′, Y) on the virtual image surface corresponding thereto, the distortion generated in the eyepiece optical system 204 is included.
The HDMI reception unit 201 receives, for example, the presented image of a 1024×576 pixel size from the image source such as the Blu-ray disc reproduction device 20.
Assume that the display image subjected to the previous opposite distortion has a 1024×576+α pixel size. The image correction unit 202 with taking into account the pixel pitch of the screen of the display unit 203 converts the size of the display image having 1024×576+a pixel size so as to be displayed on the screen. The display image is formed by the eyepiece optical system 204 on the virtual image surface. Since the display image displayed on the screen in the display unit 203 has been subjected to the previous opposite distortion, the virtual image is an image with no distortion similar to the original presented image.
As shown in FIG. 9A, assume that image coordinates on a display surface of the screen of the display unit 203 are P (X, Y) (unit: pixel) and physical coordinates on the screen of the display unit 203 are P (X, Y) (unit: mm) Here, assuming that a position of an optical axis on the display image is pa (xa, ya) position of the physical coordinates P (X, Y) corresponding to a position on the image coordinates P (X, Y) is represented as formula (9) below. Here, dp is the pixel pitch (mm/pixel) of the screen of the display unit 203
[ Math ⁢ ⁢ 9 ] P = [ X Y ] = d p ⁡ [ x - x a y a - y ] ( 9 )
On the other hand, as shown in FIG. 9B, image coordinates on the input signal surface of the virtual image which is formed by projecting the screen of the display unit 203 by the eyepiece optical system is P′ (X′, Y) (unit: pixel) and on physical coordinate the virtual image surface is P′ (X′, Y′) (unit: mm) Here, assuming that a position of the optical axis on an input image is p′a (x′a, y′a), a position of the physical coordinates P′ (X′, Y) on the screen corresponding to a coordinate position P′ (X′, Y′) on the input image is represented by formula (10) below. Here, dv is the pixel pitch (mm/pixel) on the virtual image.
[ Math ⁢ ⁢ 10 ] P ′ = [ X ′ Y ′ ] = d v ⁡ [ x ′ - x a ′ y a ′ - y ′ ] ( 10 )
Here, formula (11) below represents that the physical coordinate P (X, Y) on the screen of the display unit 203 is displaced to the physical coordinate P′ (X′, Y′) on the virtual image surface by a distortion f generated due to the eyepiece optical system 204. Here, f contains also the chromatic aberration.
[ Math ⁢ ⁢ 11 ] P = [ X Y ] ⁢ -> f ⁢ ⁢ P ′ = [ X ′ Y ′ ] = f ⁡ ( P ) ( 11 )
By use of the distortion f, the coordinate position P′ (X′, Y′) on the input image can be represented as formula (12) below using the image coordinate position P (X, Y) corresponding thereto on the display surface, the position pa (xa, ya) of the optical axis on the display image, and the position p′a (x′a, y′a) of the optical axis on the input image. Here, p is a variable, and pa and p′a are constants such as the design value.
[ Math ⁢ ⁢ 12 ] p ′ = [ x ′ y ′ ] = [ x a ′ y a ′ ] - 1 d v ⁡ [ 1 0 0 - 1 ] ⁢ f ⁡ ( [ x - x a y a - y ] ) ( 12 )
Therefore, a motion vector MV(x, y) can be obtained which gives a distortion in the direction opposite to the distortion f at arbitrary image coordinate position P (X, Y) on the display surface.
[ Math ⁢ ⁢ 13 ] MV ( x , y ) = [ x ′ y ′ ] - [ x y ] ( 13 )
As examples of a method for finding the distortion f generated due to the eyepiece optical system 204, there can cited a method by way of calculating an optical simulator used for design of lens constituting the eyepiece optical system 204, and a method by way of actual measurement using a produced real eyepiece optical system 204. In the latter method, a certain pixel P (X, Y) on display screen of the display unit 203 is made to be lighted, a virtual image of which is shot by a camera (that is, the image is shot via the eyepiece optical system 204) to find a position P′ (X′, Y′) of a luminescent spot.
By way of any of the above methods, the motion vectors MV(x, y) can be obtained at all the pixel positions P (X, Y) on the screen of the display unit 203. Tabling the respective motion vectors MV(x, y) of the pixel positions P (X, Y) to be held allows that the image correction unit 202 refers to the table for each pixel position P (X, Y) to obtain the motion vector MV(x, y) so as to give the display image the distortion in the opposite direction.
However, if the motion vectors MV(x, y) at all the pixel positions P (X, Y) on the screen of the display unit 203 are held, the table is bloated in connection with the image size.
Further, the distortion f generated due to the eyepiece optical system 204 can be calculated by the optical simulator 1401 (as described above). Specifically, a position of the pixel luminescent spot P′ (X′, Y′) on the virtual image corresponding to a certain pixel P (X, Y) on the display screen of the display unit 203 is found using light ray trace by the optical simulator 1401. The vector generation part 1402 generates, on the basis of such light ray trace data, the motion vector at each grid point in the case where the sparse grid covers over the display screen of the display unit 203.
The presented image is displayed on the screen which has been corrected by the image correction unit 202 with the distortion in the opposite direction. The display image on the screen is projected to a retina of an observer′ eye through the eyepiece optical system. When a light of the display image passes through the eyepiece optical system, the distortion is generated, in the direction opposite to which distortion the display image is given the distortion, and thus, a normal virtual image with no distortion is formed on the retina.
A description is given of a method for determining the display scale with reference to FIG. 15. First, scale limitation due to the pixel the display screen is described. As shown in formula (14) below, in a case where a pixel pb′ on an image frame of the input image is moved to a corresponding point pb on the display image, the maximum dv is found such that a condition represented by formula (15) below is met.
[ Math ⁢ ⁢ 14 ] p b ′ = [ x b ′ y b ′ ] -> ⁢ p b = [ x b y b ] ( 14 ) [ Math ⁢ ⁢ 15 ] x min ≤ x b ≤ x max y min ≤ y b ≤ y max ( 15 )
Subsequently, scale limitation due to an image circle is described. As shown in formula (16) below, in case where the pixel pb′ on the image frame of the input image is moved to the corresponding point Pb on the display screen, the maximum dv is found such that a condition represented by formula (17) below is met. Here, Rim is a radius of the image circle of the optical system.
[ Math ⁢ ⁢ 16 ] p b ′ = [ x b ′ y b ′ ] -> ⁢ P b = [ X b Y b ] ( 16 ) [ Math ⁢ ⁢ 17 ] X b 2 + Y b 2 ≤ R im ( 17 )
The pixel correction part 1003, first, moves the pixel in the same vertical line for each line to perform the correction in the vertical direction as shown in FIG. 17. After that, the pixel correction part 1003 subsequently moves the pixel in the same horizontal line for each line to perform the correction in the horizontal direction as shown in FIG. 18. In this way, separation of the processes in the vertical direction and the horizontal direction advantageously allows the process in the each direction to be achieved with a one-dimensional filter and the number of times of summing products of the filter to be reduced. For example, assuming that a tap number of the vertical direction filter is K, and a tap number of the horizontal direction filter is L, the number of times of summing products is (K+L)×M×N (here, M is a number of pixels in the vertical direction, N is a number of pixels in the horizontal direction). In contrast, if a two-dimensional filter having the same tap number in the vertical and horizontal direction is used, the number of times of summing products is large as much as K×L×M×N. Increase of the tap number increases an effect from reduction of the number of times of summing owing to the separation process in the vertical and horizontal directions.
The vector interpolation part 1002 calculates the motion vector of a pixel p=(x, y) surrounded by the grid points p11, p12, p21, and p22 on four corners, that is, the input position P=(X, Y) displayed for the display coordinates p (x, y), in accordance with formula (18) below.
t=x−x1;
s=y−y1;
X=(1−s)(1−t)X11+(1−s)tX12+s(1−t)X21+stX22;
Y=(1−s)(1−t)Y11+(1−s)tY12+s(1−t)Y21+stY22; (18)
FIG. 24 illustrates a method for previously correcting the motion vector in the vertical direction when the interpolation process is performed by way of separation in the vertical direction and the horizontal direction. A motion vector MV(A) for a grid point A can be read from the motion vector holding part 1001. Here, the vector generation part 1402 finds a grid point B by the light ray such that A=B+MV_x(B) holds. Here, MV_x(B) is a horizontal component of the motion vector MV(B). Then, a vertical component of the motion vector MV(A) at the grid point A is previously corrected into MV′_y(A)=MV_y(B).
FIG. 27 shows an exemplary implementation equivalent to that in FIG. 26. In the figure, a modulation part 2701 swings not the presented image but the motion vector (in the motion vector holding part 1001) at the ultralow frequency. In addition, an XGA interface 2703 determines the display scale in an acceptable range. When the position pa (xa, ya) of the display image is modulated, the motion vector is changed by the corresponding amount, and the maximum dv is found such that formula (19) below is met.
x min ′≦x b ≦x max′
y min ′≦y b ≦y max′ (19)
the image correction unit includes
a motion vector holding part configured to hold a motion vector expressing the distortion generated due to the eyepiece optical unit at the position of the representative pixel,
a vector interpolation part configured to interpolate a motion vector at a position of each pixel other than the representative pixel on the basis of the motion vectors of one or more representative pixels in the neighborhood, and
an eyepiece optical unit configured to project the display surface of the image display unit in a manner that a predetermined angle of view is obtained; and an image correction unit configured to correct a display image on the display surface at a position of each of representative pixels which are discretely located on the display surface, on the basis of distortion generated due to the eyepiece optical unit.
201 HDMI reception unit
202 image correction unit
204 eyepiece optical system
1001 motion vector holding part
1002 vector interpolation part
1003 pixel correction part
1401 optical simulator
1402 vector generation part
an image correction unit configured to correct a display image on the display surface at a position of each of representative pixels which are discretely located on the display surface, on the basis of distortion generated due to the eyepiece optical unit,
wherein the image correction unit includes
10. A non-transitory computer-readable medium having stored thereon a program for causing a display device to perform a correction method,
in which said display device includes an image display unit configured to display an image with a plurality of pixels arranged on a display surface and an eyepiece optical unit configured to project the display surface of the image display unit in a manner that a predetermined angle of view is obtained,
correcting a display image on the display surface at a position of each of representative pixels which are discretely located on the display surface, on the basis of distortion generated due to the eyepiece optical unit,
in which the correcting includes
holding a motion vector expressing the distortion generated due to the eyepiece optical unit at the position of the representative pixel,
interpolating a motion vector at a position of each pixel other than the representative pixel on the basis of the motion vectors of one or more representative pixels in the neighborhood, and
providing, by use of the motion vector, distortion in a direction opposite to the distortion generated due to the eyepiece optical unit to each pixel on the display surface and to correct the pixel.
US14/378,840 2012-02-22 2012-12-17 Display device, image processing device and image processing method, and computer program Active US9628766B2 (en)
JP2012-036407 2012-02-22
JP2012036407 2012-02-22
PCT/JP2012/082620 WO2013125138A1 (en) 2012-02-22 2012-12-17 Display apparatus, image processing apparatus, image processing method, and computer program
PCT/JP2012/082620 A-371-Of-International WO2013125138A1 (en) 2012-02-22 2012-12-17 Display apparatus, image processing apparatus, image processing method, and computer program
US15/150,924 Continuation US10038881B2 (en) 2012-02-22 2016-05-10 Display device, image processing device and image processing method, and computer program
US20150009416A1 US20150009416A1 (en) 2015-01-08
US9628766B2 true US9628766B2 (en) 2017-04-18
ID=49005338
US14/378,840 Active US9628766B2 (en) 2012-02-22 2012-12-17 Display device, image processing device and image processing method, and computer program
US15/150,924 Active US10038881B2 (en) 2012-02-22 2016-05-10 Display device, image processing device and image processing method, and computer program
US15/934,061 Active US10356375B2 (en) 2012-02-22 2018-03-23 Display device, image processing device and image processing method, and computer program
US (3) US9628766B2 (en)
EP (1) EP2819402A4 (en)
JP (1) JP6128113B2 (en)
CN (2) CN108364623A (en)
WO (1) WO2013125138A1 (en)
US10356375B2 (en) * 2012-02-22 2019-07-16 Sony Corporation Display device, image processing device and image processing method, and computer program
CN105869142A (en) * 2015-12-21 2016-08-17 乐视致新电子科技（天津）有限公司 Method and device for testing imaging distortion of virtual reality helmets
TWI663427B (en) * 2017-03-15 2019-06-21 宏碁股份有限公司 Head mounted display and chroma aberration compensation method using sub-pixel shifting
JPH03212762A (en) 1990-01-18 1991-09-18 Matsushita Electric Ind Co Ltd 'kana'/'kanji' converting device
JPH05176216A (en) 1991-12-24 1993-07-13 Matsushita Electric Works Ltd Lens distortion correcting system
JPH1074078A (en) 1996-08-30 1998-03-17 Yamaha Corp Two dimensional spatial converting device of picture
JPH1074077A (en) 1996-08-30 1998-03-17 Yamaha Corp Method and device for two dimensional spatial conversion of picture
JP2001069434A (en) 1999-08-27 2001-03-16 Hitachi Denshi Ltd Distortion corrector for liquid crystal projector
JP3212762B2 (en) 1993-06-11 2001-09-25 オリンパス光学工業株式会社 Display device
JP2002006220A (en) 2000-06-20 2002-01-09 Denso Corp Optical simulation method and optical simulator
JP2002296673A (en) 2001-03-29 2002-10-09 Ricoh Co Ltd Image projection device
JP2004236191A (en) 2003-01-31 2004-08-19 Nikon Corp Image display device
US20080089611A1 (en) 2006-10-17 2008-04-17 Mcfadyen Doug Calibration Technique For Heads Up Display System
JP2008103978A (en) 2006-10-19 2008-05-01 Seiko Epson Corp Projector, program and information storage medium
JP2008258802A (en) 2007-04-03 2008-10-23 Canon Inc Image display system
US20080316146A1 (en) 2007-06-25 2008-12-25 Seiko Epson Corporation Projector and image processing apparatus
JP2010252290A (en) 2009-03-26 2010-11-04 Mitsubishi Electric Corp Image processing apparatus, image processing method and image display apparatus
US20110122299A1 (en) * 2009-11-26 2011-05-26 Kabushiki Kaisha Toshiba Image processing apparatus, image processing method, and camera module
US20120026368A1 (en) * 2010-07-29 2012-02-02 Apple Inc. Binning compensation filtering techniques for image signal processing
US20120044387A1 (en) * 2010-08-20 2012-02-23 Jvc Kenwood Holdings, Inc. Image correction apparatus and image correction method
US20160078599A1 (en) * 2014-09-11 2016-03-17 Synaptics Display Devices Gk Device and method for image enlargement and display panel driver using the same
2012-12-17 EP EP12869246.4A patent/EP2819402A4/en active Pending
2012-12-17 CN CN201810287883.7A patent/CN108364623A/en active Search and Examination
2012-12-17 CN CN201280069909.1A patent/CN104115491A/en not_active Application Discontinuation
2012-12-17 WO PCT/JP2012/082620 patent/WO2013125138A1/en active Application Filing
2012-12-17 US US14/378,840 patent/US9628766B2/en active Active
2012-12-17 JP JP2014500879A patent/JP6128113B2/en active Active
2016-05-10 US US15/150,924 patent/US10038881B2/en active Active
2018-03-23 US US15/934,061 patent/US10356375B2/en active Active
CN101166288A (en) 2006-10-17 2008-04-23 精工爱普生株式会社 Calibration technique for heads up display system
JP2009005235A (en) 2007-06-25 2009-01-08 Seiko Epson Corp Projector, and image processor
US8659508B2 (en) 2007-06-25 2014-02-25 Seiko Epson Corporation Projector and image processing apparatus
Chinese Office Action for Application No. 201280069909.1 dated Feb. 3, 2017.
Extended European Search Report for EP12869246.4 Dated Jan. 21, 2016.
International Search Report from International Publication PCT/JP2012/082620 mailed Feb. 26, 2013.
Japanese Office Action for Application No. 2014500879, dated May 10, 2016.
Japanese Office Action for Application No. 2014500879, dated Nov. 22, 2016.
Partial European Search Report for EP Application No. 12869246A, dated Oct. 5, 2015.
US20150009416A1 (en) 2015-01-08
JP6128113B2 (en) 2017-05-24
EP2819402A4 (en) 2016-02-24
EP2819402A1 (en) 2014-12-31
US10038881B2 (en) 2018-07-31
WO2013125138A1 (en) 2013-08-29
US10356375B2 (en) 2019-07-16
CN104115491A (en) 2014-10-22
US20180213197A1 (en) 2018-07-26
JPWO2013125138A1 (en) 2015-07-30
US20160255317A1 (en) 2016-09-01
CN108364623A (en) 2018-08-03
CN101726854A (en) 2010-06-09 Image processing apparatus, image processing method and image processing system
JP5098869B2 (en) 2012-12-12 Image processing apparatus, image display apparatus, and image data generation method
CN101015220B (en) 2010-08-18 3d image reproduction device
JP5083052B2 (en) 2012-11-28 Stereoscopic image generation apparatus, stereoscopic image generation method, and program
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TAMAYAMA, KEN;FUJINAWA, AKIRA;SHIMIZU, MASAYUKI;AND OTHERS;SIGNING DATES FROM 20140627 TO 20140702;REEL/FRAME:033549/0942