Patent ID: 12197717

BEST MODE FOR CARRYING OUT THE INVENTION

Embodiments will be described in detail with reference to drawings. Note that the present invention is not limited to the description below, and it is easily understood by those skilled in the art that various changes and modifications can be made without departing from the spirit and scope of the present invention. Accordingly, the present invention should not be interpreted as being limited to the content of the embodiments below. Note that in the structures of the invention described below, the same portions or portions having similar functions are denoted by the same reference numerals in different drawings, and description of such portions is not repeated.

The position, size, range, and the like of each component illustrated in the drawings and the like are not accurately represented in some cases to facilitate understanding of the invention. Therefore, the disclosed invention is not necessarily limited to the position, the size, the range, or the like disclosed in the drawings and the like. For example, the position, size, range, and the like of each component are not illustrated in some cases for easy understanding.

Note that the term “over” or “below” in this specification and the like does not necessarily mean that a component is placed directly on or directly below and directly in contact with another component. For example, the expression “electrode B over insulating layer A” does not necessarily mean that the electrode B is on and in direct contact with the insulating layer A and can mean the case where another component is provided between the insulating layer A and the electrode B.

Note that ordinal numbers such as “first” and “second” and the like in this specification and the like are used in order to avoid confusion among components and do not denote the priority or the order such as the order of steps or the stacking order. A term without an ordinal number in this specification and the like might be provided with an ordinal number in a claim in order to avoid confusion among components. In addition, a term with an ordinal number in this specification and the like may be provided with a different ordinal number in a claim.

In this specification and the like, “touch” means contacting with a surface of a data processing device by part of the body of a user such as a finger or a tool such as a stylus. In this specification and the like, “tap” means hitting the surface of the data processing device with part of the body of a user such as a finger or a tool such as a stylus. In this specification and the like, “flick” means sliding part of the body of a user or a tool such as a stylus on the surface of the data processing device. In this specification and the like, “drag” means selecting part or all of an image displayed on a display portion and moving the selected image by “flick” by part of the body of a user such as a finger or a tool such as a stylus. In this specification and the like, “pinch in” means sliding two fingers on the surface of the data processing device as if pinching an object. In this specification and the like, “pinch out” means sliding two fingers on the surface of the data processing device so that they are away from each other. In this specification and the like, a proximity operation and a contact operation performed over a sensor portion, such as “touch”, “tap”, “flick”, “drag”, “pinch in”, and “pinch out” are collectively referred to as “touch action”.

Embodiment 1

In this embodiment, a structure of a data processing device of one embodiment of the present invention will be described with reference to drawings.

FIG.1shows a block diagram of a structure of a data processing device100of one embodiment of the present invention.

FIG.2Ais a schematic view illustrating the external appearance of the data processing device100of one embodiment of the present invention, andFIG.2Bis a cross-sectional view illustrating a cross-sectional structure along a cutting-plane line X1-X2 inFIG.2A.FIGS.2C and2Dare schematic views illustrating the external appearance of the data processing device100of one embodiment of the present invention, andFIG.2Eis a cross-sectional view illustrating a cross-sectional structure along a cutting-plane line X3-X4 inFIGS.2C and2D.FIG.2Cis a schematic view illustrating a front surface of the data processing device100.FIG.2Dis a schematic view illustrating a back surface of the data processing device100.

FIG.3Ais a schematic view illustrating the external appearance of the data processing device100of one embodiment of the present invention, andFIG.3Bis a cross-sectional view illustrating a cross-sectional structure along a cutting-plane line X5-X6 inFIG.3A.FIG.3Cis a cross sectional view illustrating an example of a cross-sectional structure which is different from that ofFIG.3B.

FIG.4Ais a schematic view illustrating the external appearance of the data processing device100of one embodiment of the present invention, andFIG.4Bis a cross-sectional view illustrating a cross-sectional structure along a cutting-plane line X7-X8 inFIG.4A.FIGS.4C to4Hare cross-sectional views illustrating examples of cross-sectional structures which are different from those ofFIG.4B.

As illustrated inFIGS.2C and2D, andFIG.3C, a position input portion140or a display portion130may be provided not only on the front surface but also on the side surface or the back surface of the data processing device100. As illustrated inFIG.3A, the position input portion140or the display portion130may also be provided on the top surface of the data processing device100. The position input portion140or the display portion130may also be provided on the bottom surface of the data processing device100. As illustrated inFIG.4AandFIG.4Bthat is a cross-sectional view ofFIG.4A, the position input portion140and the display portion130are not necessarily provided on the side surface, the top surface or the back surface of the data processing device100.

For example, a structure illustrated inFIGS.5A and5Bmay be employed.FIG.5Ais a schematic perspective view of the front surface side of the data processing device, andFIG.5Bis a schematic perspective view of the back surface side thereof. Alternatively, a structure illustrated inFIGS.6A and6Bmay be employed.FIG.6Ais a schematic perspective view of the front surface side of the data processing device, andFIG.6Bis a schematic perspective view of the back surface side thereof. Alternatively, a structure illustrated in FIGS.7A1and7A2may be employed. FIG.7A1is a schematic perspective view of the front surface side of the data processing device, and FIG.7A2is a schematic perspective view of the back surface side thereof. In addition, a structure illustrated in FIGS.7B1and7B2may be employed. FIG.7B1is a schematic perspective view of the front surface side of the data processing device, and FIG.7B2is a schematic perspective view of the back surface side thereof. In addition, a structure illustrated in FIGS.8A1and8A2may be employed. FIG.8A1is a schematic perspective view of the front surface side of the data processing device, and FIG.8A2is a schematic perspective view of the back surface side thereof. In addition, a structure illustrated in FIGS.8B1and8B2may be employed. FIG.8B1is a schematic perspective view of the front surface side of the data processing device, and FIG.8B2is a schematic perspective view of the back surface side thereof. In addition, a structure illustrated in FIGS.9A1and9A2may be employed. FIG.9A1is a schematic perspective view of the front surface side of the data processing device, and FIG.9A2is a schematic perspective view of the back surface side thereof. In addition, a structure illustrated in FIGS.9B1and9B2may be employed. FIG.9B1is a schematic perspective view of the front surface side of the data processing device, and FIG.9B2is a schematic perspective view of the back surface side thereof.

Note that in addition to the position input portion140, a hardware button, an external connection terminal, and the like may be provided on the surface of a housing101.

With such a structure, images can be displayed not only on the plane parallel to the front surface of the housing like in a conventional data processing device but also on the side surface of the housing. In particular, display regions are preferably provided along the two or more side surfaces of the housing because the variety of display is further increased.

A display region provided along the front surface of the data processing device and display regions provided along the side surface thereof may be independently used as display regions to display different images or the like, or two or more of the display regions may display one image or the like. For example, a continuous image may be displayed on the display region provided along the front surface of the data processing device and the display region provided along the side surface thereof and the like.

FIG.10A1is a schematic view illustrating arrangement of a position input portion140and the display portion130that can be employed in the data processing device100of one embodiment of the present invention, and FIG.10A2is a schematic view illustrating arrangement of proximity sensors142of the position input portion140.

FIG.10Bis a cross-sectional view illustrating a cross-sectional structure of the position input portion140along a cutting-plane line X9-X10 in FIG.10A2.

Example of Structure of Data Processing Device

The data processing device100described here includes an input/output unit120which supplies positional data L-INF and to which image data VIDEO is supplied and an arithmetic unit110to which the positional data L-INF is supplied and supplies the image data VIDEO (seeFIG.1).

The input/output unit120includes the position input portion140which supplies the positional data L-INF and the display portion130to which the image data VIDEO is supplied.

The position input portion140is flexible to be bent such that, for example, a first region140(1), a second region140(2) facing the first region140(1), and a third region140(3) between the first region140(1) and the second region140(2) are formed (seeFIG.2B). For another example, the position input portion140is flexible to be folded, such that the first region140(1), the third region140(3), and a fourth region140(4) facing the third region140(3) are formed (seeFIG.2E).

For another example, the position input portion140is flexible to be folded, such that the third region140(3), a fifth region140(5), the fourth region140(4) facing the third region140(3) are formed (seeFIG.3C).

Note that the surfaces or regions may be provided with the respective position input portions140. For example, as illustrated inFIGS.4C,4D, and4E, position input portions140(A),140(B),140(C),140(D), and140(E) may be provided in the respective regions. Alternatively, a structure may be employed in which some of the position input portions140(A),140(B),140(C),140(D), and140(E) are not provided as illustrated inFIG.4F. As illustrated inFIGS.4G and4H, the position input portion may be provided around the entire inside surface of a housing.

Note that the second region140(2) may face the first region140(1) with or without an inclination. Note that the fourth region140(4) may face the third region140(3) with or without an inclination.

The display portion130is supplied with the image data VIDEO and is provided to overlap with at least part of the first region140(1), the second region140(2), the third region140(3), the fourth region140(4), or the fifth region140(5). The arithmetic unit110includes an arithmetic portion111and a memory portion112that stores a program to be executed by the arithmetic portion111(seeFIG.1).

The data processing device100includes the flexible position input portion140sensing proximity or touch of an object. The position input portion140can be bent such that the first region140(1), the second region140(2) facing the first region140(1), and the third region140(3) positioned between the first region140(1) and the second region140(2) and overlapping with the display portion130are formed, for example. With this structure, whether or not a palm or a finger is proximate to or touches the first region140(1), the second region140(2), or the like can be determined. As a result, a human interface with high operability can be provided. Furthermore, a novel data processing device with high operability can be provided.

Individual components included in the data processing device100are described below (seeFIG.1). Note that these units can not be clearly distinguished and one unit also serves as another unit or include part of another unit in some cases.

For example, a touch panel in which a touch sensor overlaps with a display portion is provided over the position input portion140as well as over the display portion130.

<<Input/Output Device>>

The input/output unit120includes the position input portion140and the display portion130. An input/output portion145, a sensor portion150, a communication portion160, and the like may also be included. The input/output unit120is supplied with data and can supply data (seeFIG.1).

<<Position Input Portion>>

The position input portion140supplies the positional data L-INF. The user of the data processing device100can supply the positional data L-INF to the position input portion140by touching the position input portion140with his/her finger or palm and thereby supplying a variety of operation instructions to the data processing device100. For example, an operation instruction including a termination instruction (an instruction to terminate the program) can be supplied (seeFIG.1).

The position input portion140includes, for example, the first region140(1), the second region140(2), and the third region140(3) between the first region140(1) and the second region140(2) (see FIG.10A1). In each of the first region140(1), the second region140(2), and the third region140(3), the proximity sensors142are arranged in matrix (see FIG.10A2).

The position input portion140includes, for example, a flexible substrate141and the proximity sensors142over the flexible substrate141(seeFIG.10B).

The position input portion140can be bent such that the second region140(2) and the first region140(1) face each other (seeFIG.2B).

The third region140(3) of the position input portion140overlaps with the display portion130(seeFIGS.2Band10A1). Note that when the third region140(3) is positioned closer to the user than the display portion130is, the third region140(3) has a light-transmitting property.

The distance between the second region and the first region of the position input portion140in a bent state is one that allows the user of the data processing device100to hold it in his/her hand (see FIG.14A1). The distance is, for example, 17 cm or shorter, preferably 9 cm or shorter, further preferably 7 cm or shorter. When the distance is short, the thumb of the holding hand can be used to input the positional data to a wide range of the third region140(3).

Thus, the user of the data processing device100can use the data processing device100, holding it with the thumb joint portion (the vicinity of the thenar) being proximate to or touching one of the first region140(1) and the second region140(2), and a finger(s) other than the thumb being proximate to or touching the other.

The shape of the thumb joint portion (the vicinity of the thenar) being proximate to or touching one of the first region140(1) and the second region140(2) is different from the shape(s) of the finger(s) other than the thumb being proximate to or touching the other region; therefore, the first region140(1) supplies positional data different from that supplied by the second region140(2). Specifically, the shape of the thumb joint portion (the vicinity of the thenar) being proximate to or touching one region is larger than the shape(s) of the finger(s) other than the thumb being proximate to or touching the other region or is continuous (not divided), for example.

The proximity sensor142is a sensor that can sense proximity or touch of an object (e.g., a finger or a palm), and a capacitor or an imaging element can be used as the proximity sensor. Note that a substrate provided with capacitors arranged in matrix can be referred to as a capacitive touch sensor, and a substrate provided with an imaging element can be referred to as an optical touch sensor.

For the flexible substrate141, a resin thin enough to be flexible can be used. Examples of the resin include polyester, polyolefin, polyamide, polyimide, aramid, epoxy, polycarbonate, and an acrylic resin.

As a normal substrate not having flexibility, a glass substrate, a quartz substrate, a semiconductor substrate, or the like can be used.

Specific examples of a structure that can be employed in the position input portion140are described in Embodiments 6 and 7.

<<Display Portion>>

The display portion130and at least the third region140(3) of the position input portion140overlap with each other. Not only the third region140(3) but also the first region140(1) and/or the second region140(2) may overlap with the display portion130.

There is no particular limitation on the display portion130as long as the display portion130can display the supplied image data VIDEO.

An operation instruction associated with a portion of the display portion130with which the first region140(1) and/or the second region140(2) overlap(s) may be different from an operation instruction associated with a portion of the display portion130with which the third region140(3) overlaps.

The user can thus see, from display on the display portion, what operation instruction is associated with the portion with which the first region140(1) and/or the second region140(2) overlap(s). Consequently, a variety of operation instructions can be associated. Moreover, false input of an operation instruction can be reduced.

Specific examples of a structure that can be employed in the display portion130are described in Embodiments 6 and 7.

<<Arithmetic Unit>>

The arithmetic unit110includes the arithmetic portion111, the memory portion112, an input/output interface115, and a transmission path114(seeFIG.1).

The arithmetic unit110is supplied with the positional data L-INF and supplies the image data VIDEO.

For example, the arithmetic unit110supplies the image data VIDEO including an image used for operation of the data processing device100, and the input/output unit120is supplied with the image data VIDEO including the image used for operation. The display portion130displays the image used for operation.

By touching a portion of the third region140(3) overlapping with the display portion130in which an image used for operation is displayed with his/her finger, the user can supply the positional data L-INF for selecting the image.

<<Arithmetic Portion>>

The arithmetic portion111executes the program stored in the memory portion112. For example, in response to supply of the positional data L-INF that is associated with a position in which an image used for operation is displayed, the arithmetic portion111executes a program associated with the image.

<<Memory Portion>>

The memory portion112stores the program to be executed by the arithmetic portion111.

Note that examples of a program to be executed by the arithmetic unit110are described in other embodiments.

<<Input/Output Interface and Transmission Path>>

The input/output interface115supplies data and is supplied with data.

The transmission path114can supply data, and the arithmetic portion111, the memory portion112, and the input/output interface115are supplied with data. In addition, the arithmetic portion111, the memory portion112, and the input/output interface115can supply data and the transmission path114is supplied with data.

The data processing device100includes the arithmetic unit110, the input/output unit120, and the housing101(seeFIG.1andFIG.2B).

<<Sensor Portion>>

The sensor portion150senses the states of the data processing device100and the circumstances and supplies sensing data SENS (seeFIG.1).

Note that the sensor portion150senses, for example, acceleration, a direction, pressure, a global positioning system (GPS) signal, temperature, humidity, or the like and may supply data thereon.

<<Communication Unit>>

The communication portion160supplies data COM supplied by the arithmetic unit110to a device or a communication network outside the data processing device100. Furthermore, the communication portion160acquires the data COM from the device or communication network outside the data processing device100and supplies the data COM.

The data COM can include a variety of instructions and the like. For example, the data COM can include a display instruction to make the arithmetic portion111generate or delete the image data VIDEO.

A communication unit for connection to the external device or external communication network, e.g., a hub, a router, or a modem, can be used for the communication portion160. Note that the connection method is not limited to a method using a wire, and a wireless method (e.g., radio wave or infrared rays) may be used.

<<Input/Output Unit>>

As the input/output portion145, for example, a camera, a microphone, a read-only external memory portion, an external memory portion, a scanner, a speaker, or a printer can be used (seeFIG.1).

Specifically, as a camera, a digital camera, digital video camera, or the like can be used.

As an external memory portion, a hard disk, a removable memory, or the like can be used. As a read-only external memory portion, a CD-ROM, a DVD-ROM, or the like can be used.

<<Housing>>

The housing101protects the arithmetic unit110and the like from external stress.

The housing101can be formed using metal, plastic, glass, ceramics, or the like.

This embodiment can be combined with any of the other embodiments in this specification as appropriate.

Embodiment 2

In this embodiment, the structure of the data processing device of one embodiment of the present invention will be described with reference to drawings.

FIG.11shows a block diagram of a structure of a data processing device100B of one embodiment of the present invention.

FIGS.12A to12Care schematic views illustrating the external appearance of the data processing device100B.FIG.12Ais the schematic view illustrating the external appearance of the data processing device100B in an unfolded state,FIG.12Bis the schematic view illustrating the external appearance of the data processing device100B in a bent state, andFIG.12Cis the schematic view illustrating the external appearance of the data processing device100B in a folded state.

FIGS.13A to13Eare schematic views illustrating the structures of the data processing device100B.FIGS.13A to13Dillustrate the structure in an unfolded state andFIG.13Eillustrates the structure in a folded state.

FIG.13Ais a top view of the data processing device100B,FIG.13Bis a bottom view of the data processing device100B, andFIG.13Cis a side view of the data processing device100B.FIG.13Dis a cross-sectional view illustrating a cross section of the data processing device100B taken along a cutting-plane line Y1-Y2 inFIG.13A.FIG.13Eis a side view of the data processing device100B in the folded state.

Example of Structure of Data Processing Device

The data processing device100B described here includes an input/output unit120B which supplies the positional data L-INF and the sensing data SENS including folding data and to which the image data VIDEO is supplied and the arithmetic unit110to which the positional data L-INF and the sensing data SENS including the folding data are supplied and which supplies the image data VIDEO (seeFIG.11).

The input/output unit120B includes a position input portion140B, the display portion130, and the sensor portion150.

The position input portion140B is flexible to be unfolded or folded such that the first region140B(1), the second region140B(2) facing the first region140B(1), and the third region140B(3) between the first region140B(1) and the second region140B(2) are formed (seeFIGS.12A to12CandFIGS.13A to13E).

The sensor portion150includes a folding sensor151capable of sensing a folded state of the position input portion140B and supplying the sensing data SENS including the folding data.

The display portion130is supplied with the image data VIDEO and is positioned so that the display portion130and the third region140B(3) overlap with each other. The arithmetic unit110includes the arithmetic portion111and the memory portion112that stores the program to be executed by the arithmetic portion (seeFIG.13D).

The data processing device100B described here includes the flexible position input portion140B sensing a palm or a finger that is proximate to the first region140B(1), the second region140B(2) facing the first region140B(1) in the folded state, and the third region140B(3) positioned between the first region140B(1) and the second region140B(2) and overlapping with the display portion130; and the sensor portion including the folding sensor151capable of determining whether the flexible position input portion140B is in a folded state or an unfolded state (seeFIG.11andFIGS.13A to13E). With this structure, whether or not a palm or a finger is proximate to the first region140B(1) or the second region140B(2) can be determined. As a result, a human interface with high operability can be provided. Furthermore, a novel data processing device with high operability can be provided.

Individual components included in the data processing device100B are described below. Note that these units can not be clearly distinguished and one unit also serves as another unit or include part of another unit in some cases.

For example, a touch panel in which a touch sensor overlaps with a display portion is provided over the position input portion140B as well as over the display portion130.

The data processing device100B is different from the data processing device described in Embodiment 1 in that the position input portion140B is flexible to be in an unfolded state or a folded state and that the sensor portion150in the input/output unit120B includes the folding sensor151. Different structures will be described in detail below, and the above description is referred to for the other similar structures.

<<Input/Output Device>>

The input/output unit120B includes the position input portion140B, the display portion130, and the sensor portion150including the folding sensor151. The input/output portion145, a sign159, the communication portion160, and the like may also be included. The input/output unit120B is supplied with data and can supply data (FIG.11).

<<Structure Enabling Folding and Unfolding of Data Processing Device>>

The data processing device100B has a housing in which a high flexibility portion E1 and a low flexibility portion E2 are alternately provided. In other words, in the housing of the data processing device100B, the high flexibility portion E1 and the low flexibility portion E2 are strip-like portions (form stripes) (seeFIGS.13A and13B).

The above-described structure allows the data processing device100B to be folded (seeFIGS.12A to12C). The data processing device100B in a folded state is highly portable. It is possible to fold the data processing device100B such that part of the third region140B(3) of the position input portion140B is on the outer side and use only part of the third region140B(3) (seeFIG.12C).

The high flexibility portion E1 and the low flexibility portion E2 can have a shape both sides of which are parallel to each other, a triangular shape, a trapezoidal shape, a fan shape, or the like.

The user of the data processing device100B folded to a size that allows the data processing device to be held in one hand can operate part of the third region140B(3) of the position input portion with the thumb of his/her hand supporting the data processing device and input positional data. In the above manner, the data processing device that can be operated with one hand can be provided (seeFIG.15A).

Note that in a folded state such that parts of the position input portion140are on the inner side, the user cannot operate part of the third region140B(3) (seeFIG.12C). Thus, it is possible to stop driving of part of the third region140B(3) of the position input portion in a folded state. In that case, the data processing device100B can have reduced power consumption with the position input portion in a folded state.

The position input portion140B in an unfolded state is seamless and has a wide operation region.

The display portion130and the third region140B(3) of the position input portion overlap with each other (seeFIG.13D). The position input portion140B is interposed between a connecting member13aand a connecting member13b. The connecting member13aand the connecting member13bare interposed between a supporting member15aand a supporting member15b(seeFIG.13C).

The display portion130, the position input portion140B, the connecting member13a, the connecting member13b, the supporting member15a, and the supporting member15bare fixed by any of a variety of methods; for example, it is possible to use an adhesive, a screw, structures that can be fit with each other, or the like.

<<High Flexibility Portion>>

The high flexibility portion E1 is bendable and functions as a hinge.

The high flexibility portion E1 includes the connecting member13aand the connecting member13boverlapping with each other (seeFIGS.13A to13C).

<<Low Flexibility Portion>>

The low flexibility portion E2 includes at least one of the supporting member15aand the supporting member15b. For example, the low flexibility portion E2 includes the supporting member15aand the supporting member15boverlapping with each other. Note that when only the supporting member15bis included, the weight and thickness of the low flexibility portion E2 can be reduced.

<<Connecting Member>>

The connecting member13aand the connecting member13bare flexible. For example, flexible plastic, metal, alloy and/or rubber can be used as the connecting member13aand the connecting member13b. Specifically, silicone rubber can be used as the connecting member13aand the connecting member13b.

<<Supporting Member>>

Any one of the supporting member15aand the supporting member15bhas lower flexibility than the connecting member13aand the connecting member13b. The supporting member15aor the supporting member15bcan increase the mechanical strength of the position input portion140B and protect the position input portion140B from breakage.

For example, plastic, metal, alloy, rubber, or the like can be used as the supporting member15aor the supporting member15b. The connecting member13a, the connecting member13b, the supporting member15a, or the supporting member15bformed using plastic, rubber, or the like can be lightweight or break-resistant.

Specifically, engineering plastic or silicone rubber can be used. Stainless steel, aluminum, magnesium alloy, or the like can also be used for the supporting member15aand the supporting member15b.

<<Position Input Portion>>

The position input portion140B can be in an unfolded state or a folded state (seeFIGS.12A to12C).

The third region140B(3) in an unfolded state is positioned on a top surface of the data processing device100B (seeFIG.13C), and the third region140B(3) in a folded state is positioned on the top surface and a side surface of the data processing device100B (seeFIG.13E).

The usable area of the unfolded position input portion140B is larger than that of the folded position input portion140B.

When the position input portion140B is folded, an operation instruction that is different from an operation instruction associated with a portion of the third region140B(3) on the top surface of the data processing device100B can be associated with a portion of the third region140B(3) on the side surface of the data processing device100B. Note that an operation instruction that is different from an operation instruction associated with the second region140B(2) may be associated with the portion of the third region140B(3) on the side surface of the data processing device100B. In this manner, a complex operation instruction can be given with the use of the position input portion140B.

The position input portion140B supplies the positional data L-INF (seeFIG.11).

The position input portion140B is provided between the supporting member15aand the supporting member15b. The position input portion140B may be interposed between the connecting member13aand the connecting member13b.

The position input portion140B includes the first region140B(1), the second region140B(2), and the third region140B(3) between the first region140B(1) and the second region140B(2) (seeFIG.13D).

The position input portion140B includes a flexible substrate and proximity sensors over the flexible substrate. In each of the first region140B(1), the second region140B(2), and the third region140B(3), the proximity sensors are arranged in matrix.

Specific examples of a structure that can be employed in the position input portion140B are described in Embodiments 6 and 7.

<<Sensor Portion and Sign>>

The data processing device100B includes the sensor portion150. The sensor portion150includes the folding sensor151(seeFIG.11).

The folding sensor151and the sign159are positioned in the data processing device100B so that a folded state of the position input portion140B can be sensed (FIGS.12A and12BandFIGS.13A,13C, and13E).

In a state where the position input portion140B is unfolded, the sign159is positioned away from the folding sensor151(seeFIG.12AandFIGS.13A and13C).

In a state where the position input portion140B is bent at the connecting members13a, the sign159is close to the folding sensor151(seeFIG.12B).

In a state where the position input portion140B is folded at the connecting members13a, the sign159faces the folding sensor151(seeFIG.13E).

The sensor portion150senses the sign159to determine that the position input portion140B is in a folded state and supplies the sensing data SENS including folding data.

<<Display Portion>>

The display portion130and at least part of the third region140(3) of the position input portion140overlap with each other. The display portion130can display the supplied image data VIDEO.

Particularly when flexible, the display portion130can be unfolded or folded with the position input portion140overlapping with the display portion130. Thus, seamless display with excellent browsability can be performed by the display portion130.

Specific examples of a structure that can be employed in the flexible display portion130are described in Embodiments 6 and 7.

<<Arithmetic Unit>>

The arithmetic unit110includes the arithmetic portion111, the memory portion112, an input/output interface115, and a transmission path114(seeFIG.11).

This embodiment can be combined with any of the other embodiments in this specification as appropriate.

Embodiment 3

In this embodiment, a structure of a data processing device of one embodiment of the present invention will be described with reference to drawings.

FIGS.14A1,14A2,14B1, and14B2illustrate a state where the data processing device100of one embodiment of the present invention is held by a user. FIG.14A1illustrates the external appearance of the data processing device100held by a user, and FIG.14A2illustrates the ranges of a palm and fingers holding the data processing device100that are sensed by the proximity sensor in the position input portion140illustrated in FIG.14A1. Note that the case where separate position input portions140(A),140(B), and140(C) are used is illustrated inFIG.17A. The description for the case ofFIG.17Acan apply to the case of FIG.14A2.

FIG.14B1is a schematic view where solid lines denote results of edge sensing processing of first positional data L-INF(1) sensed by the first region140(1) of the position input portion140and second positional data L-INF(2) sensed by the second region140(2). FIG.14B2is a schematic view where hatching patterns denote results of labelling processing of the first positional data L-INF(1) and the second positional data L-INF(2).

FIGS.16A and16Bare flow charts showing the programs to be executed by the arithmetic portion111of the data processing device of one embodiment of the present invention.

Example of Structure of Data Processing Device

The data processing device described here is the data processing device100in Embodiment 1 in which the first region140(1) supplies the first positional data L-INF(1) and the second region140(2) supplies the second positional data L-INF(2) (see FIG.14A2); and the image data VIDEO to be displayed on the display portion130with which the third region140(3) overlaps is generated by the arithmetic portion111in accordance with results of a comparison between the first positional data L-INF(1) and the second positional data L-INF(2) (seeFIG.1,FIGS.2A to2E, FIGS.10A1,10A2,10B and FIGS.14A1,14A2,14B1, and14B2).

Individual components included in the data processing device100are described below. Note that these units can not be clearly distinguished and one unit also serves as another unit or include part of another unit in some cases.

For example, a touch panel in which a touch sensor overlaps with a display portion is provided over the position input portion140as well as over the display portion130.

The data processing device100is different from the data processing device described in Embodiment 1 in that the first region of the position input portion140supplies the first positional data and the second region of the position input portion140supplies the second positional data, and that an image to be displayed on the display portion130is generated in accordance with results of a comparison between the first positional data and the second positional data. Different structures will be described in detail below, and the above description is referred to for the other similar structures.

<<Position Input Portion>>

The position input portion140is flexible to be bent such that the first region140(1), the second region140(2) facing the first region140(1), and the third region140(3) provided between the first region140(1) and the second region140(2) and overlapping with the display portion130are formed (seeFIG.2B).

FIG.14A1illustrates the data processing device100held by a user. In FIG.14A2, the ranges of a palm and fingers holding the data processing device100that are sensed by the proximity sensor in the position input portion140are illustrated together with the position input portion140in the unfolded state.

The first region140(1) and the second region140(2) of the data processing device100held by a user sense part of the user's palm and part of the user's fingers. For example, the first region140(1) supplies the first positional data L-INF(1) including data on contact positions of part of the index finger, the middle finger, and the ring finger, and the second region140(2) supplies the second positional data L-INF(2) including data on a contact position of the thumb joint portion (the vicinity of the thenar). Note that the third region140(3) supplies data on a contact position of the thumb.

<<Display Portion>>

The display portion130and the third region140(3) overlap with each other (see FIGS.14A1and14A2). The display portion130is supplied with the image data VIDEO and displays the image data VIDEO. For example, the image data VIDEO including an image used for operation of the data processing device100can be displayed. A user of the data processing device100can input positional data for selecting the image, by making his/her thumb touch the third region140(3) overlapping with the image.

For example, a keyboard131, icons, and the like are displayed on the right side as illustrated inFIG.17Bwhen operation is performed with the right hand. The keyboard131, icons, and the like are displayed on the left side as illustrated inFIG.17Cwhen operation is performed with the left hand. In this way, operation with fingers is facilitated.

Note that a displayed screen may be changed in response to sensing of inclination of the data processing device100by the sensor portion150that senses acceleration. For example, the left end of the data processing device100held in the left hand as illustrated inFIG.18Ais positioned higher than the right end as illustrated inFIG.18Cwhen seen in the direction denoted by an arrow152. Here, in response to sensing of this inclination, a screen for the left hand is displayed as illustrated inFIG.17Cand the keyboard131for the left hand is operated. In a similar manner, the right end of the data processing device100held in the right hand as illustrated inFIG.18Bis positioned higher than the left end as illustrated inFIG.18Dwhen seen in the direction denoted by the arrow152. Here, in response to sensing of this inclination, a screen for the right hand is displayed as illustrated inFIG.17Band the keyboard131for the right hand is operated. The display positions of a keyboard, icons, and the like may be controlled in this manner.

Note that the method for sensing inclination of the data processing device100and the method illustrated in FIGS.14A1,14A2,14B1, and14B2may be combined to control the display positions. Alternatively, without sensing of information, the screen may be switched between an operation screen for the right hand and an operation screen for the left hand by the user of the data processing device100.

<<Arithmetic Portion>>

The arithmetic portion111is supplied with the first positional data L-INF(1) and the second positional data L-INF(2) and generates the image data VIDEO to be displayed on the display portion130in accordance with results of a comparison between the first positional data L-INF(1) and the second positional data L-INF(2).

Example of Structure of Data Processing Device

The data processing device described here is different from the data processing device described in Embodiment 1 or that described above in that the memory portion stores a program in accordance with which the arithmetic portion111executes the following seven steps (seeFIG.16A). Different processes will be described in detail below, and the above description is referred to for the other similar processes.

Example of Program

In a first step, the length of a first line segment is determined using the first positional data L-INF(1) supplied by the first region140(1) (see51inFIG.16A).

In a second step, the length of a second line segment is determined using the second positional data L-INF(2) supplied by the second region140(2) (see S2 inFIG.16A).

In a third step, the length of the first line segment and the length of the second line segment are compared with the predetermined length. The program proceeds to a fourth step when only one of the lengths of the first and second line segments is longer than the predetermined length. The program proceeds to the first step in other cases (see S3 inFIG.16A). Note that it is preferable that the predetermined length be longer than or equal to 2 cm and shorter than or equal to 15 cm, and it is particularly preferable that the predetermined length be longer than or equal to 5 cm and shorter than or equal to 10 cm.

In a fourth step, the coordinates of the midpoint of the line segment longer than the predetermined length are determined (see S4 inFIG.16A).

In a fifth step, whether “tap”, “flick”, or the like is performed in a region in which the coordinates of the midpoint is not determined is checked in the first region140(1) or the second region140(2) (see S5 inFIG.16A).

In a sixth step, the image data VIDEO to be displayed on the display portion which overlaps with the third region140(3) is generated based on the coordinates of the midpoint and whether the operation of “tap” or “flick” has been performed confirmed in the fifth step (see S6 inFIG.16A).

In a seventh step, the program is terminated (see S7 inFIG.16A).

The data processing device100described here includes the flexible position input portion140capable of sensing proximity or touch of an object and supplying the positional data L-INF, and the arithmetic portion111. The flexible position input portion140can be bent such that the first region140(1), the second region140(2) facing the first region140(1), and the third region140(3) positioned between the first region140(1) and the second region140(2) and overlapping with the display portion are formed. The arithmetic portion111can compare the first positional data L-INF(1) supplied by the first region140(1) with the second positional data L-INF(2) supplied by the second region140(2) and generate the image data VIDEO to be displayed on the display portion130.

With this structure, whether a palm or a finger is proximate to or touches the first region140(1) or the second region140(2) can be determined, furthermore, whether the data processing device is operated with one hand or whether it is operated with both hands can be determined, and the image data VIDEO including an image (e.g., an image used for operation) positioned for easy operation can be generated. As a result, a human interface with high operability can be provided. Furthermore, a novel data processing device with high operability can be provided.

Note that a step in which the display portion130displays the predetermined image data VIDEO (also referred to as initial image) may be included before the first step. In that case, the predetermined image data VIDEO can be displayed when both the length of the first line segment and that of the second line segment are longer or shorter than the predetermined length.

Individual processes executed by the arithmetic portion with the use of the program are described below. Note that these processes cannot be clearly distinguished and one process also serves as another process or include part of another process in some cases.

<<Method for Determining Midpoint of Line Segment>>

Hereinafter, a method for determining the length of the first line segment and the length of the second line segment using the first positional data L-INF(1) and the second positional data L-INF(2), respectively, is described. A method for determining the midpoint of a line segment is also described.

Specifically, an edge sensing method for determining the length of a line segment is described.

Note that although description is given of an example in which an imaging element is used as the proximity sensor, a capacitor or the like may be used as the proximity sensor.

Assume that a value acquired by an imaging pixel with coordinates (x, y) is f(x, y). It is preferable that a value obtained by subtracting a background value from a value sensed by the imaging pixel be used as fix, y) because noise can be removed.

<<Method for Extracting Edge (Contour)>>

Formula 1 below expresses the sum Δ(x, y)of differences between a value sensed by the imaging pixel with the coordinates (x, y) and values sensed by imaging pixels with coordinates (x−1, y), coordinates (x+1, y), coordinates (x, y−1), and coordinates (x, y+1), which are adjacent to the coordinates (x, y).
Δ(x,y)=4·f(x,y)−{f(x,y−1)+f(x,y+1)+f(x−1,y)+f(x+1,y)}  [Formula 1]

FIG.14A2shows values sensed by the imaging pixels in the first region140(1) and the second region140(2). FIG.14B1shows calculation results of Δ(x, y). When Δ(x, y)is used in the above manner, an edge (contour) of a finger or a palm that is proximate to or touches the first region140(1) and the second region140(2) can be extracted to the first region140(1) and the second region140(2).

<<Method for Determining Length of Line Segment>>

The coordinates of intersection between the contour extracted to the first region140(1) and a predetermined line segment W1 are determined, and the predetermined line segment W1 is cut at the point of intersection to be divided into a plurality of line segments. The line segment having the longest length among the plurality of line segments is the first line segment. Note that the length of the first line segment is length L1 (seeFIG.14-B1).

The coordinates of intersection between the contour extracted to the second region140(2) and a predetermined line segment W2 are determined, and the predetermined line segment W2 is cut at the point of intersection to be divided into a plurality of line segments. The line segment having the longest length among the plurality of line segments is the second line segment. Note that the length of the second line segment is length L2.

<<Method for Determining Midpoint>>

The length of the first line segment L1 and the length of the second line segment L2 are compared with each other, the longer one is selected, and the coordinates of a midpoint M is calculated. In this embodiment, the length L2 is longer than the length L1; thus, the coordinates of the midpoint M of the second line segment are determined.

<<Image Data Generated in Accordance with Coordinates of Midpoint>>

The coordinates of the midpoint M can be associated with the position of the thumb joint portion (the vicinity of the thenar), the movable range of the thumb, or the like. In this manner, image data that facilitates operation of the data processing device can be generated in accordance with the coordinates of the midpoint M.

For example, it is possible to generate the image data VIDEO that includes an image used for operation positioned in the display portion130with which the third region140(3) in the movable range of the thumb overlaps. Specifically, images used for operation (denoted by circles) can be positioned on a circular arc whose center is in the vicinity of the midpoint M (see FIG.14A1). Among images used for operation, images that are used frequently may be positioned on a circular arc and images that are used less frequently may be positioned inside or outside the circular arc. As a result, a human interface with high operability can be provided. Furthermore, a novel data processing device with high operability can be provided.

In the case where an operations such as “tap” or “flick” are detected in the region in which the midpoint M is not calculated in the first region140(1) and the second region140(2), it can be determined that a user operates the data processing device100with both hands, and a predetermined processing such as the display of image data VIDEO which is different from the above can be executed. For example, when the operations such as “tap” or “flick” are detected in the second region140(2) at the same time as the midpoint M is calculated in the first region140(1), it can be determined that a user operates the data processing device100with both hands, and a predetermined image can be displayed on the display portion130.

In the case where the operations such as “tap” or “flick” are detected in the region in which the midpoint M is not calculated in the first region140(1) and the second region140(2), the predetermined processing may be performed by determining that the data processing device is not operated by both hands. For example, predetermined program execution, display or non-display of images, or turning on or off a power source may be performed.

Example of Structure of Data Processing Device

The data processing device described here is different from the data processing device described in Embodiment 1 or that described above in that the memory portion stores a program in accordance with which the arithmetic portion111executes the following six steps, in which the area of a first figure and the area of a second figure are used instead of the length of the first line segment and the length of the second line segment (seeFIG.16B). Different processes will be described in detail below, and the above description is referred to for the other similar processes.

Example of Program

In a first step, the area of the first figure is determined using the first positional data L-INF(1) supplied by the first region140(1) (T1 inFIG.16B).

In a second step, the area of the second figure is determined using the second positional data L-INF(2) supplied by the second region140(2) (T2 inFIG.16B).

In a third step, the area of the first figure and the area of the second figure are compared with the predetermined area. The program proceeds to a fourth step when only one of the areas of the first and second figures is larger than the predetermined area. The program proceeds to the first step in other cases (T3 inFIG.16B). Note that it is preferable that the predetermined area be larger than or equal to 1 cm2and smaller than or equal to 8 cm2, and it is particularly preferable that the predetermined area be larger than or equal to 3 cm2and smaller than or equal to 5 cm2.

In a fourth step, the barycentric coordinates of the figure whose area is larger than the predetermined area are determined (T4 inFIG.16B).

In a fifth step, whether “tap”, “flick”, or the like is performed in a region in which barycentric coordinates are not determined in the first region140(1) and the second region140(2) is checked (see T5 inFIG.16A).

In a sixth step, the image data VIDEO to be displayed on the display portion which overlaps with the third region is generated based on the barycentric coordinates and whether the operation of “tap” or “flick” has been performed confirmed in the fifth step (T6 inFIG.16B).

In a seventh step, the program is terminated (see T7 inFIG.16B).

Individual processes executed by the arithmetic portion with the use of the program are described below. Note that these processes cannot be clearly distinguished and one process also serves as another process or include part of another process in some cases.

<<Method for Determining Center of Area>>

Hereinafter, a method for determining the area of the first figure and the area of the second figure using the first positional data L-INF(1) and the second positional data L-INF(2), respectively, is described. A method for determining the center of gravity of a figure is also described.

Specifically, labeling processing for determining the area of a figure is described.

Note that although description is given of an example in which an imaging element is used as the proximity sensor, a capacitor or the like may be used as the proximity sensor.

Assume that a value acquired by an imaging pixel with coordinates (x, y) is f(x, y). It is preferable that a value obtained by subtracting a background value from a value sensed by the imaging pixel be used as f(x, y)because noise can be removed.

<<Labelling Processing>>

In the case where one imaging pixel and an adjacent imaging pixel in the first region140(1) and the second region140(2) each acquire a value f(x, y)exceeding a predetermined threshold value, the region where the region occupied by these imaging pixels is regarded as one figure. Note that when f(x, y)can be 256, for example, it is preferable that the predetermined threshold value be greater than or equal to 0 and less than or equal to 150, and it is particularly preferable that the predetermined threshold value be greater than or equal to 0 and less than or equal to 50.

The above processing is performed on all of the imaging pixels in the first region140(1) and the second region140(2), and imaging of the results is carried out to give the regions in which adjacent imaging pixels each exceeds the predetermined threshold value as shown in FIGS.14A2and14B2. The figure having the largest area among figures in the first region140(1) is the first figure. The figure having the largest area among figures in the second region140(2) is the second figure.

<<Method for Determining Center of Gravity of Figure>>

The area of the first figure and that of the second figure are compared, the larger one is selected, and the center of gravity is calculated. Coordinates Cox, Y) of the center of gravity can be calculated using Formula (2) below.

C(X,Y)=(1n⁢∑i=0n-1xi,1n⁢∑i=0n-1yi)[Formula⁢2]

In Equation (2), (x, y) represents the coordinates of n imaging pixels forming one figure. The area of the second figure is larger than that of the first figure; thus, the barycentric coordinates C of the second figure are determined.

<<Image Data Generated in Accordance with Barycentric Coordinates>>

The barycentric coordinates C can be associated with the position of the thumb joint portion (the vicinity of the thenar), the movable range of the thumb, or the like. In this manner, image data that facilitates operation of the data processing device100can be generated in accordance with the barycentric coordinates C.

In the case where an operations such as “tap” or “flick” are detected in the region in which the center of gravity C is not calculated in the first region140(1) and the second region140(2), it can be determined that a user operates the data processing device100by both hands, and the image data VIDEO which is different from above can be displayed.

In the case where an operations such as “tap” or “flick” are detected in the region in which the center of gravity C is not calculated in the first region140(1) and the second region140(2), operations other than the display of the image data VIDEO may be performed. For example, execution of a predetermined program, display or non-display of images or turning on or off a power source may be performed.

In the case where the position input portion140is provided on the front surface and the back surface of the data processing device100, the position input portion140of the front surface and the back surface are tapped at the same time, whereby execution of the predetermined program, display or non-display of images, or turning on or off a power source may be performed, for example (seeFIG.19A). In addition, portions of the position input portion140of the front surface and the back surface are “flicked” at the same time, whereby execution of the predetermined program, display or non-display of images, turning on or off a power source may be performed, for example (seeFIG.19B). Therefore, unexpected malfunctions can be prevented.

This embodiment can be combined with any of the other embodiments in this specification as appropriate.

Embodiment 4

In this embodiment, a structure of a data processing device of one embodiment of the present invention will be described with reference to drawings.

FIGS.15A and15Billustrate a state where the data processing device100B of one embodiment of the present invention is held by a user.FIG.15Aillustrates the data processing device100B in a folded state held by a user, andFIG.15Billustrates the ranges of a palm and fingers sensed by the data processing device100B in the state illustrated inFIG.15A. Note that the ranges of the palm and fingers are illustrated together with the unfolded position input portion140B.

FIG.20is a flow chart showing the program to be executed by the arithmetic portion111of the data processing device100B of one embodiment of the present invention.

FIGS.21A to21Cillustrate an example of an image displayed on the display portion130of the data processing device100B of one embodiment of the present invention.

FIG.22is a flow chart showing the program to be executed by the arithmetic portion111of the data processing device100B of one embodiment of the present invention.

Example of Structure of Data Processing Device

In a data processing device described here, the first region140B(1) of the position input portion140B supplies the first positional data L-INF(1), and the second region140B(2) supplies the second positional data L-INF(2) (seeFIG.15B). The sensor portion150supplies the sensing data SENS including folding data; and the image data VIDEO to be displayed on the display portion130is generated by the arithmetic portion111in accordance with the sensing data SENS including the folding data and results of a comparison between the first positional data L-INF(1) and the second positional data L-INF(2) (seeFIG.11,FIGS.12A to12C, andFIGS.15A and15B).

Individual components included in the data processing device100B are described below. Note that these units can not be clearly distinguished and one unit also serves as another unit or include part of another unit in some cases.

For example, a touch panel in which a touch sensor overlaps with a display portion is provided in the position input portion140B as well as in the display portion130.

The data processing device100B is different from the data processing device described in Embodiment 2 in that the first region140B(1) of the position input portion140B supplies the first positional data and the second region140B(2) of the position input portion140B supplies the second positional data, and that an image to be displayed on the display portion130is generated in accordance with results of a comparison between the first positional data and the second positional data. Different structures will be described in detail below, and the above description is referred to for the other similar structures.

<<Position Input Portion>>

The position input portion140B is flexible to unfolded or folded such that the first region140B(1), the second region140B(2) facing the first region140B(1), and the third region140B(3) provided between the first region140B(1) and the second region140B(2) and overlapping with the display portion130B are formed (seeFIGS.12A to12C).

The first region140B(1) and the second region140B(2) which the user's palm and the user's fingers are proximate to or touch sense part of the user's palm and part of the user's fingers. For example, the first region140B(1) supplies the first positional data L-INF(1) including data on contact positions of part of the index finger, the middle finger, and the ring finger, and the second region140B(2) supplies the second positional data L-INF(2) including data on a contact position of the thumb joint portion (the vicinity of the thenar). Note that the third region140B(3) supplies data on a contact position of the thumb.

<<Display Portion>>

The display portion130and the third region140B(3) overlap with each other (seeFIGS.15A and15B). The display portion130is supplied with the image data VIDEO and can display an image used for operation of the data processing device100B, for example. A user of the data processing device100B can input positional data for selecting the image, by making his/her thumb touch the third region140B(3) overlapping with the image.

<<Arithmetic Portion>>

The arithmetic portion111is supplied with the first positional data L-INF(1) and the second positional data L-INF(2) and generates the image data VIDEO to be displayed on the display portion130in accordance with results of a comparison between the first positional data L-INF(1) and the second positional data L-INF(2).

Example of Structure of Data Processing Device

The data processing device described here is different from the data processing device described in Embodiment 2 or that described above in that the memory portion stores a program in accordance with which the arithmetic portion111executes the following nine steps (seeFIG.20). Different processes will be described in detail below, and the above description is referred to for the other similar processes.

Example of Program

In a first step, the length of the first line segment is determined using the first positional data supplied by the first region (U1 inFIG.20).

In a second step, the length of the second line segment is determined using the second positional data supplied by the second region (U2 inFIG.20).

In a third step, the length of the first line segment and the length of the second line segment are compared with the predetermined length. The program proceeds to a fourth step when only one of the lengths of the first and second line segments is longer than the predetermined length. The program proceeds to the first step in other cases (U3 inFIG.20). Note that it is preferable that the predetermined length be longer than or equal to 2 cm and shorter than or equal to 15 cm, and it is particularly preferable that the predetermined length be longer than or equal to 5 cm and shorter than or equal to 10 cm.

In the fourth step, the coordinates of the midpoint of the line segment longer than the predetermined length are determined (U4 inFIG.20).

In a fifth step, whether or not the operation such as “tap” or “flick” is performed in a region in which the coordinates of the midpoint are not determined in the first region140(1) and the second region140(2) is checked (see U5 inFIG.20A).

In a sixth step, the folding data of the data processing device100B is acquired. The program proceeds to a seventh step when the folding data indicates the folded state (U6 inFIG.20).

In the seventh step, the first image data to be displayed on the display portion with which the third region overlaps is generated in accordance with the coordinates of the midpoint and whether the operation of “tap” or “flick” has been performed which is confirmed in the fifth step (U7 inFIG.20).

In the sixth step, the folding data of the data processing device100B is acquired. The program proceeds to an eighth step when the folding data indicates the folded state (U5 inFIG.20).

In the eighth step, the second image data to be displayed on the display portion with which the third region overlaps is generated in accordance with the coordinates of the midpoint and whether the operation of “tap” or “flick” has been performed which is confirmed in the fifth step (U8 inFIG.20).

In the ninth step, the program is terminated (see U9 inFIG.20).

The data processing device100B described here includes the flexible position input portion140B capable of sensing proximity or touch of an object and supplying the positional data L-INF; the sensor portion150including the folding sensor151that can determine whether the flexible position input portion140B is in a folded state or an unfolded state; and the arithmetic portion111(seeFIG.11). The flexible position input portion140B can be bent such that the first region140B(1), the second region140B(2) facing the first region140B(1) in the folded state, and the third region140B(3) positioned between the first region140B(1) and the second region140B(2) and overlapping with the display portion130are formed. The arithmetic portion111can compare the first positional data L-INF(1) supplied by the first region140B(1) with the second positional data L-INF(2) supplied by the second region140B(2) and generate the image data VIDEO to be displayed on the display portion130in accordance with the folded state.

With this structure, whether or not a palm or a finger is proximate to or touches the first region140B(1) or the second region140B(2) can be determined, furthermore, whether data processing device is operated with one hand or with both hands can be determined, and the image data VIDEO including a first image positioned for easy operation in the folded state of the position input portion140B (e.g., the first image in which an image used for operation is positioned) or a second image positioned for easy operation in the unfolded state of the position input portion140B can be generated. As a result, a human interface with high operability can be provided. Furthermore, a novel data processing device with high operability can be provided.

In the data processing device100B described here, a step in which the predetermined image data VIDEO is generated by the arithmetic portion111and displayed by the display portion130may be included before the first step. In that case, the predetermined image data VIDEO can be displayed when both the length of the first line segment and that of the second line segment are longer or shorter than the predetermined length in the third step.

Individual processes executed by the arithmetic portion with the use of the program are described below. Note that these processes cannot be clearly distinguished and one process also serves as another process or include part of another process in some cases.

The program to be executed by the arithmetic portion111of the data processing device100B is different from the program to be executed by the arithmetic portion of the data processing device in Embodiment 3 in that in the fifth step, the process is branched in accordance with the folded state of the position input portion140B. Different processes will be described in detail below, and the above description is referred to for the other similar processes.

<<Process for Generating First Image Data>>

When the acquired folding data indicates the folded state, the arithmetic portion generates the first image data. For example, in a manner similar to that of the fifth step of the program to be executed by the arithmetic portion111of the data processing device100in Embodiment 3, first image data VIDEO to be displayed on the display portion130with which the third region140B(3) in the folded state overlaps is generated in accordance with the coordinates of the midpoint and whether the operation of “tap” or “flick” has been performed which is confirmed in the fifth step.

The coordinates of the midpoint M can be associated with the position of the thumb joint portion (the vicinity of the thenar), the movable range of the thumb, or the like. In the case where an operation such as “tap” or “flick” is not detected in the region in which the midpoint M is not calculated in the first region140(1) and the second region140(2), it can be determined that a user operates the data processing device100with one hand, and image data that facilitates the operation of the data processing device100B in the folded state can be generated in accordance with the coordinates of the midpoint M.

For example, it is possible to generate the first image data VIDEO for one-hand operation that includes an image used for operation positioned in the display portion with which the third region140B(3) in the movable range of the thumb overlaps. Specifically, images used for operation (denoted by circles) can be positioned on a circular arc whose center is in the vicinity of the midpoint M (seeFIG.21A). Among images used for operation, images that are used frequently may be positioned on a circular arc and images that are used less frequently may be positioned inside or outside the circular arc. As a result, a human interface with high operability can be provided in the data processing device100B in the folded state. Furthermore, a novel data processing device with high operability can be provided.

In the case where an operations such as “tap” or “flick” are detected in the region in which the midpoint M is not calculated in the first region140(1) and the second region140(2), it can be judged that the data processing device100is operated with both hands, so that the first image data VIDEO for two-hand operation can be displayed. Note that the first image data VIDEO for one-hand operation and the first image data VIDEO for two-hand operation can be the same.

In the case where operations such as “tap” or “flick” are detected in the region in which midpoint M is not calculated in the first region140(1) and the second region140(2), operations other than the display of the imaged data VIDEO may be performed. For example, execution of the predetermined program, display or non-display of images or turning on or off a power source may be performed.

<<Process for Generating Second Image Data>>

When the acquired folding data indicates the unfolded state, the arithmetic portion111generates the second image data. For example, in a manner similar to that of the fifth step of the program to be executed by the arithmetic portion111of the data processing device100in Embodiment 3, first image data VIDEO to be displayed on the display portion130with which the third region140B(3) in the folded state overlaps is generated in accordance with the coordinates of the midpoint and whether the operation of “tap” or “flick” has been performed which is confirmed in the fifth step. The coordinates of the midpoint M can be associated with the position of the thumb joint portion (the vicinity of the thenar), the movable range of the thumb, or the like.

For example, it is possible to generate second image data VIDEO that includes an image used for operation not positioned in an area with which the movable range of the thumb overlaps. For example, in the case where an operation such as “tap” or “flick” is not detected in the region in which midpoint M is not calculated in the first region140(1) and the second region140(2), it can be determined that a user operates the data processing device100with one hand, and images used for operation (denoted by circles) can be positioned outside a circular arc whose center is in the vicinity of the midpoint M (seeFIGS.21A to21C). The position input portion140B may be driven such that the position input portion140B supplies positional data in response to sensing of an object that is proximate to or touches the circular arc or a region outside the circular arc.

The user can support the data processing device100B by holding the circular arc or a region inside the circular arc in the position input portion140B in the unfolded state with one hand. The image used for operation and displayed outside the circular arc can be operated with the other hand. As a result, a human interface with high operability can be provided in the data processing device100B in the unfolded state. Furthermore, a novel data processing device with high operability can be provided.

In the case where an operations such as “tap” or “flick” are detected in the region in which midpoint M is not calculated in the first region140(1) and the second region140(2) (seeFIGS.21A and21B), it can be judged that the data processing device is operated with both hands, so that the second image data VIDEO for two-hand operation can be displayed. Note that the first image data VIDEO for one-hand operation and the second image data VIDEO for two-hand operation can be the same.

In the case where the operations such as “tap” or “flick” are detected in the region in which midpoint M is not calculated in the first region140(1) and the second region140(2), operations other than the display of the image data VIDEO may be performed. For example, execution of the predetermined program, display or non-display of images or turning on or off a power source may be performed.

Example of Structure of Data Processing Device

The data processing device described here is different from the data processing device described in Embodiment 2 or that described above in that the memory portion stores a program in accordance with which the arithmetic portion111executes the following seven steps, in which the area of the first figure and the area of the second figure are used instead of the length of the first line segment and the length of the second line segment (seeFIG.22). Different processes will be described in detail below, and the above description is referred to for the other similar processes.

Example of Program

In a first step, the area of the first figure is determined using the first positional data supplied by the first region140B(1) (see V1 inFIG.22).

In a second step, the area of the second figure is determined using the second positional data supplied by the second region140B(2) (see V2 inFIG.22).

In a third step, the area of the first figure and the area of the second figure are compared with the predetermined area. The program proceeds to a fourth step when only one of the area of the first figure and the area of the second figure is larger than the predetermined area. The program proceeds to the first step in other cases (see V3 inFIG.22). Note that it is preferable that the predetermined area be larger than or equal to 1 cm2and smaller than or equal to 8 cm2, and it is particularly preferable that the predetermined area be larger than or equal to 3 cm2and smaller than or equal to 5 cm2.

In a fourth step, the barycentric coordinates of the area which is larger than the predetermined area are determined (see V4 inFIG.22).

In a fifth step, the folding data of the data processing device100B is acquired. The program proceeds to the sixth step when the folding data indicates the folded state (see V5 inFIG.22).

In a sixth step, whether operations of “tap”, “flick”, or the like are performed in a region in which the coordinates of the midpoint are not determined in the first region140(1) and the second region140(2) is checked (see V6 inFIG.22).

In a seventh step, the first image data to be displayed on the display portion which overlaps with the third region is generated in accordance with the barycentric coordinates and whether the operation of “tap” or “flick” has been performed confirmed in the sixth step (see V7 inFIG.22).

In a fifth step, the folding data of the data processing device100B is acquired. The program proceeds to the eighth step when the folding data indicates the folded state (see V5 inFIG.22).

In an eighth step, the second image data to be displayed on the display portion with which the third region overlaps is generated in accordance with the barycentric coordinates (see V8 inFIG.22).

The program is terminated in a ninth step (see V9 inFIG.22).

This embodiment can be combined with any of the other embodiments in this specification as appropriate.

Embodiment 5

In this embodiment, an operation example that can be used for the data processing device of one embodiment of the present invention will be described with reference to drawings.

In the case where the data processing device100is held by a user, a specific region of the position input portion140is touched for a long time. In the display portion130, display on a region overlapping with the region touched or rewriting data in the region overlapping with the region touched is not performed, whereby power consumption of the data processing device100can be suppressed. Since a region touched is a blind spot, visibility of the display image is not decreased when the display in the region overlapping with the region touched is stopped. Here, the region in which the display is stopped may be smaller than the region touched, for example. In that case, display appears to be performed even if a hand holding the data processing device moves a little.

In the display portion130, there may be a region in which display is not performed or a region in which a rewriting operation is not performed may be provided in a region other than touched region. For example, when the data processing device is held by a user, there might be a region in which a user cannot view the display images near the region touched even though the region is not touched. A region in which display is not performed or a region in which a rewriting operation is not performed may be provided even in such a region.

As an example of such a case, the case of contacting the display portion130with a palm can be given. When a palm contacts the display portion130, the entire palm does not necessary contact the display portion. Even in a region with which palm is not in contact, however, the palm prevents a user from viewing the region in some cases. Thus, display or a rewriting operation is not necessarily performed in such a region.

Here, the terms “display is not performed” and “rewriting operation is not performed” refer to not supplying a new image signal or charge to pixels in the display portion130. Furthermore, the terms indicate that light is not supplied from the lighting device such as a backlight or a frontlight. For example, in the case of using a light-emitting element for the pixel, black display is performed in the region that is not supplied with an image signal in some cases. In addition, in the case where a display element that is not a light emitting element (e.g., a liquid crystal element) is used for the pixel, black display or white display is performed depending on a pixel configuration. Moreover, in the case of using a liquid crystal element as the pixel, an image which is displayed just before the supply of an image signal is stopped might be continuously displayed. For example, in the case of using a transistor including an oxide semiconductor in a channel portion, the same image may be continuously displayed because the off-state current of the transistor is extremely small. Furthermore, in the case of using a liquid crystal element for the pixel, black display may be performed in the region to which illumination light from the backlight is not supplied.

In the case where a user holds the data processing device100with a hand and the like, the region held by the hand can be determined by various methods.

For example, as described in the above embodiments, the edge detection processing is performed based on the first positional data L-INF (1) sensed by the first region140(1) of the position input portion140and a second positional data L-INF (2) sensed by a second region140(2), and when the arithmetic portion111determines that the area or the barycentric coordinates of the region surrounded by the edge is not changed for a certain period or longer, a portion of the display of the display portion overlapping with the region is stopped. Alternatively, the display image rewriting of a portion of the display portion130that overlaps with the region is stopped. A similar processing may be performed using a third positional data L-INF (3) sensed by the third region140(3). In the case where the data processing device100includes a fourth region140(4) and a fifth region140(5), for example, a similar processing may be performed based on fourth positional data L-INF (4) sensed by the fourth region140(4) and a fifth positional data L-INF (5) sensed by the fifth region140(5), for example.

Alternatively, all the touched regions are simply detected, and the regions which are determined to be touched for a certain period or longer may be determined to be a region which is held by a hand or the like. Alternatively, the regions may be determined by using another sensor such as an acceleration sensor, an optical sensor, and an infrared ray sensor. In such a manner, the regions that are held by a hand can be determined by using and combining various methods.

For example, as shown inFIG.32(A), a region A which is touched for a certain period or longer by a hand or the like does not react. In addition, a region B does not react because the region B is not in contact with anything. Next, as shown inFIG.32(B), when a finger or the like touches the region B, the region B reacts but the region A does not react. It is possible to operate the data processing device100by such a method.

Example of Program

An example of a program for making the arithmetic portion111execute the processing by which display is not performed in the region overlapping with the region touched for a certain period will be described with reference toFIG.23. The data processing device described here has a memory portion storing a program for making the arithmetic portion111execute the following eight steps. Note that the data processing device described in the above embodiments can be appropriately used as the data processing device.

In a first step, a region a1 that is touched over the position input portion140is identified based on the first positional data L-INF (1) to the fourth positional data L-INF (4), and the like (see R1 inFIG.23).

In a second step, the area and the barycentric coordinates of the region a1 are calculated (R2 inFIG.23).

In a third step, the data processing device stands by for a certain period (R3 inFIG.23). Note that the stand-by time is preferably 1 second or longer and shorter than seconds, and more preferably 1 second or longer and shorter than 15 seconds. When the stand-by time is too long, the display quality of the data processing device is likely to decrease because the display in the display portion130overlapping with the region a1 might not be performed even after the holding position changed or holding is stopped.

In a fourth step, a region a2 over the position input portion140which is touched is identified based on the first positional data L-INF (1) to the fourth positional data L-INF (4), or the like (R4 inFIG.23).

In a fifth step, the area and the barycentric coordinates of the region a2 are calculated (R5 inFIG.23).

In a sixth step, whether there are big differences in the areas and the barycentric coordinates between the region a1 and the region a2 is determined (R6 inFIG.23).

In the case where there is no great difference in at least one of the areas and the barycentric coordinates between the region a1 and the region a2, a seventh step is performed (R7 inFIG.23).

In the seventh step, display of the display portion130overlapping with the region a1 is stopped. Alternatively, display image rewriting of the display portion130overlapping with the region a1 is stopped. After that, the operation returns to the third step, and the data processing device stands by for a certain period.

In the sixth step, in the case where there is a great difference in at least one of the areas and the barycentric coordinates between the region a1 and the region a2, the execution of the program is terminated in an eighth step.

In such a manner, power consumption of the data processing device100can be suppressed.

Note that although the display or the display image rewriting of the display portion130overlapping with the region a1 is stopped in the seventh step, one embodiment of the present invention is not limited thereto. For example, in the seventh step, when the display or the display image rewriting of the display portion130is stopped, it is also stopped not only in the region touched for a certain period but also in the vicinity thereof. Alternatively, the display or the display image rewriting of the display portion130is stopped in a region which is a slightly smaller than the region touched for a certain period.

In the case ofFIGS.2C,2D, and2E, for example, when the region touched for a certain period exists in any part of the fourth region140(4), the display of a region of the display portion130that overlaps with the entire part of the first region140(4) is stopped, or the display image rewriting is stopped. Similarly, for example, in the case where a region touched for a certain period exists in any part of the first region140(1), the display of a region of the display portion130that overlaps with the entire part of the first region140(1) is stopped, or the display image rewriting is stopped. For example, since the fourth region140(4) corresponds to the back surface of the data processing device100, the fourth region140(4) is a place which is hardly viewed by a user when the data processing device is held. Accordingly, when the display portion130may be not viewed from a user, the display or the display image rewriting is temporarily stopped in the entire part of such a region. However, when the third region140(3) is not touched for a certain period, the display is restored, for example. Thus, the display can be performed only when a user is viewing, which results in reducing the power consumption.

In the case where a user views the fourth region140(4), the third region140(3) substantially corresponds to the back surface of the data processing device100. Thus, for example, in such a case, in a manner similar to the case of the fourth region140(4), the display or the display image rewriting of the display portion130is stopped in the entire part of the third region140(3).

At least one of the region determining whether the region is touched for a long time; the region determining whether the region is touched for holding the data processing device by a user; the region in which the display of the display portion130is stopped; and the region in which the display image rewriting of the display portion130may be set to be a part of a region of the display portion130. Furthermore, the position of the region, a judgment operation or a display operation performed in the region, and the like may be changed according to the situation. In addition, they may be set and changed by a user.

For example, whether a region is touched for a long time or is touched for holding the device is not necessarily determined in the region corresponding to the front surface of the data processing device100, such as in the third region140(3).

Furthermore, in such a region, the display or the display image rewriting of the display portion130is not necessarily stopped. In this manner, a user can view a display image even when the user rapidly changes the holding state of the data processing device100.

Furthermore, an acceleration sensor, a magnetic sensor, or the like may be used for determining whether a user is viewing the back surface or the front surface of the data processing device100. By utilizing data of these sensors, circumstances can be precisely judged.

In the case where the data processing device100is held by a user, when the region held by a user is included in the region determining touch action, touch action cannot be accurately determined, which causes malfunction or decrease in operability. In addition, there is a risk of dropping the data processing device100when a user holds a region of the data processing device100except for the region determining touch action.

Hence, for example, a region touched by a user unintentionally is excluded from the region determining touch action in the position input portion140. Furthermore, for example, a region of the position input portion140touched by a user for holding the data processing device100is excluded from the region determining touch action. Alternatively, for example, a region which cannot be touched even if a user intends to is excluded from the region determining touch action. For example, a region touched for a certain period is excluded from a region determining touch action in the position input portion140. Thus, detection accuracy of touch action can be improved. Furthermore, favorable operability of the data processing device100can be obtained.

As an example of a region which cannot be touched even if a user intends to, a region in contact with a palm can be given. In the case where a palm touches the region, the entire palm is not necessarily in contact with the region. Even if the region is not touched by a palm, the palm prevents the other hand from touching the region.

As an example of a region which cannot be touched even if a user intends to touch, small spaces between fingers at the time of touching with a plurality of fingers can be given. The spaces cannot be touched with another hand. In this manner, a region which cannot be touched even if a user intends to touch may be excluded from the region determining touch action.

In the case where the data processing device100is held by a hand or the like, the region held by a hand can be judged by various methods.

For example, as described in the above embodiments, the edge detection process is performed based on the first positional data L-INF (1) sensed by the first region140(1) of the position input portion140and the second positional data L-INF (2) sensed by the second region140(2), and when the arithmetic portion111judges that the area or the barycentric coordinates of a region surrounded by the edge is not changed for a certain period or longer, the region is excluded from the region determining touch action. The similar processing may be performed using the third positional data L-INF (3) sensed by the third region140(3). In the case where the data processing device100includes the fourth region140(4), the fifth region140(5), and the like, the same processing may be performed based on the results of the fourth positional data L-INF (4) sensed by the fourth region140(4) and the fifth positional data L-INF (5) sensed by the fifth region140(5), and the like.

Alternatively, all the touched regions are simply detected, and the region which is determined to be touched for a certain period or longer may be determined to be a region which is held by a hand, or the like. Alternatively, the regions may be determined by using another sensor such as an acceleration sensor, an optical sensor, and an infrared ray sensor. In such a manner, the regions that are held with a hand can be determined by using and combining various methods.

Example of Program

An example of a program for making the arithmetic portion111execute the processing by which a region touched for a certain period is excluded from the region determining touch action will be described with reference toFIG.24. The data-processing device described here has the memory portion storing a program for making the arithmetic portion111execute the following eight steps. Note that, the data processing device described in the above embodiments can be appropriately used as the data processing device.

In a first step, a region a1 that is touched over the position input portion140is identified based on the first positional data L-INF (1) to the fourth positional data L-INF (4), and the like (see W1 inFIG.24).

In a second step, the area and the barycentric coordinates of the region a1 are calculated (see W2 inFIG.24).

In a third step, the data processing device stands by for a certain period (see W3 inFIG.24). The stand by time is preferably 1 second or longer and shorter than seconds, and more preferably 1 second or longer and shorter than 15 seconds. When the stand-by time is too long, display quality of the data processing device100is likely to decrease because the display in the display portion130that overlaps with a region a1 is not performed in some cases even after the holding position changed or holding is stopped.

In a fourth step, a region a2 that is touched over the position input portion140is identified based on the first positional data L-INF (1) to the fourth positional data L-INF (4), and the like (see W4 inFIG.24).

In a fifth step, the area and the barycentric coordinates of a region a2 are calculated (see W5 inFIG.24).

In a sixth step, whether there are big differences in the area and the barycentric coordinates between region a1 and the region a2 is judged (see W6 inFIG.24).

In the case where there is no great difference in at least one of the areas and the barycentric coordinates between the region a1 and the region a2, a seventh step is performed (see W7 inFIG.24).

In the seventh step, a region touched for a certain period is excluded from the region determining the touching action in the position input portion140.

In the sixth step, in the case where there is a great difference in at least one of the areas and the barycentric coordinates of the region a1 and the region a2, the execution of the program is terminated in an eighth step.

In such a manner, detection accuracy of touch action of the data processing device100can be improved. Furthermore, favorable operability of the data processing device100can be obtained. Since a user does not need to be careful not to touch the region determining touch action, the data processing device100can be easily held. Since it becomes easy for a user to operate the data processing device100by one hand while holding the data processing device100by the other hand, the user can easily operate the data processing device100by both hands.

Note that, although the region touched for a certain period is excluded from the region determining the touching action in the position input portion140in the seventh step, one embodiment of the present invention is not limited thereto. For example, in the seventh step, when the region touched for a certain period is excluded from the region determining the touch action in the position input portion140, the vicinity of the region touched for a certain period can also be excluded from the region determining touch action.

In the case ofFIGS.2A and2B, for example, when a region touched for a certain period exists in any part of the second region140(2), the entire part of the second region140(2) is excluded from the region determining touch action. Similarly, for example, when a region touched for a certain period exists in any part of the first region140(1), the entire part of the first region140(1) is excluded from the region determining touch action. Since the first region140(1) and the second region140(2) correspond to the side surfaces of the data processing device100, the first region140(1) and the second region140(2) are regions that are easily touched. Thus, such regions may be temporarily excluded from the regions determining touch action. Note that, when the first region140(1) and the second region140(2) are not touched for a certain period, the regions are returned to the regions determining touch action. Accordingly, touch action can be utilized only when a user intends to perform operations.

At least one of the region determining whether the region is touched for a long time, the region determining whether the region is touched by a user for holding the data processing device, and the region determining touch action may be set to be a part of the region of the display portion130. Furthermore, the position of the region, a judgment operation or a display operation performed in the region, and the like may be changed according to the situation. In addition, they may be set and changed by a user.

For example, whether a region is touched for a long time or is touched for holding the data processing device is not necessarily judged in the region corresponding to the front surface of the data processing device100such as the third region140(3). In addition, such a region is not necessarily excluded from the region determining touch action. Thus, a user can use the data processing device100smoothly in some cases.

Note that instead of determining whether a region is touched for a certain period, a user may set a specific region which is excluded from the region determining touch action. For example, in a normal use, only a front surface such as the third region140(3) may be set to be the region determining touch action. Then, the other regions are excluded from the region determining touch action. The settings are changed according the usage of the data processing device. Thus, a user can easily operate the data processing device100.

Furthermore, an acceleration sensor, a magnetic sensor, or the like can be used for determining whether a user is viewing the back surface or the front surface of the data processing device100. By utilizing the data of these sensors, circumstances can be precisely determined.

The program described above is not only used in the data processing device but also used in data processing devices in other embodiments. InFIG.25, a data processing device100B which is unfolded is held by a left hand, and touch action is performed on the position input portion140overlapping with the display portion130by a right hand. With the use of the program described above in the data processing device100B, the display of the region held by a left hand is stopped, which results in reducing the power consumption. Alternatively, with use of the program described above in the data processing device100B, the region held by a left hand is excluded from the region determining touch action, whereby the detection accuracy of touch action of the data processing device100B can be improved. Alternatively, favorable operability of the data processing device100B can be obtained.

When the data processing device100is held by a user, in a region of the display portion130overlapping with the region touched, an operation of not performing the display of the region or an operation of not performing rewriting operation of the region, and an operation of excluding the region from the region determining touch action can be carried out in combination. For example, display is not performed and touch action is not judged in the region touched by a user for holding the data processing device100.

This embodiment can be combined with any of the other embodiments in this specification as appropriate.

Embodiment 6

In this embodiment, the structure of a display panel that can be used for a position input portion and a display device of the data processing device of one embodiment of the present invention will be described with reference toFIGS.26A to26C. Note that the display panel described in this embodiment includes a touch sensor (a contact sensor device) that overlaps with a display portion; thus, the display panel can be called a touch panel (an input/output device).

FIG.26Ais a top view illustrating the structure of a display panel that can be used for a position input portion and a display device of the data processing device of one embodiment of the present invention.

FIG.26Bis a cross-sectional view taken along line A-B and line C-D inFIG.26A.

FIG.26Cis a cross-sectional view taken along line E-F inFIG.26A.

<Top View>

An input/output device300described as an example in this embodiment includes a display portion301(seeFIG.26A).

The display portion301includes a plurality of pixels302and a plurality of imaging pixels308. The imaging pixels308can sense a touch of a finger or the like on the display portion301. Thus, a touch sensor can be formed using the imaging pixels308.

Each of the pixels302includes a plurality of sub-pixels (e.g., a sub-pixel302R). In addition, in the sub-pixels, light-emitting elements and pixel circuits that can supply electric power for driving the light-emitting elements are provided.

The pixel circuits are electrically connected to wirings through which selection signals are supplied and wirings through which image signals are supplied.

Furthermore, the input/output device300is provided with a scan line driver circuit303g(1) that can supply selection signals to the pixels302and an image signal line driver circuit303s(1) that can supply image signals to the pixels302. Note that when the image signal line driver circuit303s(1) is placed in a portion other than a bendable portion, malfunction can be inhibited.

The imaging pixels308include photoelectric conversion elements and imaging pixel circuits that drive the photoelectric conversion elements.

The imaging pixel circuits are electrically connected to wirings through which control signals are supplied and wirings through which power supply potentials are supplied.

Examples of the control signals include a signal for selecting an imaging pixel circuit from which a recorded imaging signal is read, a signal for initializing an imaging pixel circuit, and a signal for determining the time it takes for an imaging pixel circuit to detect light.

The input/output device300is provided with an imaging pixel driver circuit303g(2) that can supply control signals to the imaging pixels308and an imaging signal line driver circuit303s(2) that reads out imaging signals. Note that when the imaging signal line driver circuit303s(2) is placed in a portion other than a bendable portion, malfunction can be inhibited.

<Cross-Sectional View>

The input/output device300includes a substrate310and a counter substrate that faces the substrate310(seeFIG.26B).

The substrate310is a stacked body in which a flexible substrate310b, a barrier film310athat prevents diffusion of unintentional impurities to the light-emitting elements, and an adhesive layer310cthat attaches the barrier film310ato the substrate310bare stacked.

The counter substrate370is a stacked body including a flexible substrate370b, a barrier film370athat prevents diffusion of unintentional impurities to the light-emitting elements, and an adhesive layer370cthat attaches the barrier film370ato the substrate370b(seeFIG.26B).

A sealant360attaches the counter substrate370to the substrate310. The sealant360also serving as an optical adhesive layer has a refractive index higher than that of air. The pixel circuits and the light-emitting elements (e.g., a first light-emitting element350R) and the imaging pixel circuits and photoelectric conversion elements (e.g., a photoelectric conversion element308p) are provided between the substrate310and the counter substrate370.

<<Structure of Pixel>>

Each of the pixels302includes a sub-pixel302R, a sub-pixel302G, and a sub-pixel302B (seeFIG.26C). The sub-pixel302R includes a light-emitting module380R, the sub-pixel302G includes a light-emitting module380G, and the sub-pixel302B includes a light-emitting module380B.

For example, the sub-pixel302R includes the first light-emitting element350R and the pixel circuit that can supply electric power to the first light-emitting element350R and includes a transistor302t(seeFIG.26B). Furthermore, the light-emitting module380R includes the first light-emitting element350R and an optical element (e.g., a coloring layer367R).

The transistor302tincludes a semiconductor layer. As the semiconductor layer, any layer which is semiconductive can be used. For example, a semiconductor such as silicon and germanium, a compound semiconductor such as gallium arsenide, an oxide semiconductor such as indium oxide, zinc oxide, indium gallium zinc oxide, and an organic semiconductor can be used. Furthermore, the semiconductor layer may have crystallinity such as a single crystal, a polycrystal, a microcrystal, and the like. Furthermore, the semiconductor layer may be amorphous. The characteristics of the oxide semiconductor are less likely to change even when a change in shape such as bending is given to the oxide semiconductor. Thus, an oxide semiconductor is preferably used for a semiconductor layer of a transistor to be formed over a flexible substrate.

Although a channel-etched transistor that is a type of bottom-gate transistor is illustrated as the transistor302tin this embodiment, a channel-protective transistor can be used. In addition, the transistor302tmay be a top-gate transistor.

The transistor302tmay have a single gate structure including one channel formation region in a semiconductor layer, a double gate structure including two channel formation regions in a semiconductor layer, or a triple gate structure including three channel formation regions in a semiconductor layer.

The transistor302tmay include a back gate electrode, with which the threshold value of the transistor302tmay be controlled.

The light-emitting element350R includes a first lower electrode351R, an upper electrode352, and a layer353containing a light-emitting organic compound between the first lower electrode351R and the upper electrode352(seeFIG.26C).

The layer353containing a light-emitting organic compound includes a light-emitting unit353a, a light-emitting unit353b, and an intermediate layer354between the light-emitting units353aand353b.

The light-emitting module380R includes the first coloring layer367R on the counter substrate370. The coloring layer transmits light of a particular wavelength and is, for example, a layer that selectively transmits light of red, green, or blue color. A region that transmits light emitted from the light-emitting element as it is may be provided as well.

The light-emitting module380R, for example, includes the sealant360that is in contact with the first light-emitting element350R and the first coloring layer367R.

The first coloring layer367R is positioned in a region overlapping with the first light-emitting element350R. Accordingly, part of light emitted from the first light-emitting element350R passes through the sealant360that also serves as an optical adhesive layer and through the first coloring layer367R and is emitted to the outside of the light-emitting module380R as indicated by arrows inFIGS.26B and26C.

<<Structure of Input/Output Unit>>

The input/output device300includes a light-blocking layer367BM on the counter substrate370. The light-blocking layer367BM is provided so as to surround the coloring layer (e.g., the first coloring layer367R).

The input/output device300includes an anti-reflective layer367ppositioned in a region overlapping with the display portion301. As the anti-reflective layer367p, a circular polarizing plate can be used, for example.

The input/output device300includes an insulating film321. The insulating film321covers the transistor302t. Note that the insulating film321can be used as a layer for planarizing unevenness caused by the pixel circuits. An insulating film on which a layer that can prevent diffusion of impurities to the transistor302tand the like is stacked can be used as the insulating film321.

The input/output device300includes the light-emitting elements (e.g., the first light-emitting element350R) over the insulating film321.

The input/output unit300includes, over the insulating film321, a partition wall328that overlaps with an end portion of the first lower electrode351R (seeFIG.26C). In addition, a spacer329that controls the distance between the substrate310and the counter substrate370is provided on the partition wall328.

<<Structure of Image Signal Line Driver Circuit>>

The image signal line driver circuit303s(1) includes a transistor303tand a capacitor303c. Note that the image signal line driver circuit303s(1) can be formed in the same process and over the same substrate as those of the pixel circuits. The transistor303thas a structure similar to that of the transistor302t. Note that the transistor303tmay have a structure different from that of the transistor302t.

<<Structure of Imaging Pixel>>

The imaging pixels308each include a photoelectric conversion element308pand an imaging pixel circuit for sensing light received by the photoelectric conversion element308p. The imaging pixel circuit includes a transistor308t. The transistor308thas a structure similar to that of the transistor302t. Note that the transistor308tmay have a structure different from that of the transistor302t.

For example, a PIN photodiode can be used as the photoelectric conversion element308p.

<<Other Structures>>

The input/output device300includes a wiring311through which a signal can be supplied. The wiring311is provided with a terminal319. Note that an FPC309(1) through which a signal such as an image signal or a synchronization signal can be supplied is electrically connected to the terminal319. The FPC309(1) is preferably placed in a portion other than a bendable portion of the input/output unit300. Moreover, the FPC309(1) is preferably placed at almost the center of one side of a region surrounding the display portion301, especially a side which is folded (a longer side inFIG.26A). Accordingly, the distance between an external circuit for driving the input/output unit300and the input/output unit300can be made short, resulting in easy connection. Furthermore, the center of gravity of the external circuit can be made almost the same as that of the input/output unit300. As a result, the data processing device can be treated easily and mistakes such as dropping can be prevented.

Note that a printed wiring board (PWB) may be attached to the FPC309(1).

Note that although the case where the light-emitting element is used as a display element is illustrated, one embodiment of the present invention is not limited thereto.

For example, in this specification and the like, a display element, a display device which is a device including a display element, a light-emitting element, and a light-emitting device which is a device including a light-emitting element can employ a variety of modes or can include a variety of elements. Examples of a display element, a display device, a light-emitting element, or a light-emitting device include a display medium whose contrast, luminance, reflectance, transmittance, or the like is changed by electromagnetic action, such as an electroluminescence (EL) element (e.g., an EL element including organic and inorganic materials, an organic EL element, or an inorganic EL element), an LED (e.g., a white LED, a red LED, a green LED, or a blue LED), a transistor (a transistor that emits light depending on current), an electron emitter, a liquid crystal element, electronic ink, an electrophoretic element, a grating light valve (GLV), a plasma display panel (PDP), a display element using micro electro mechanical system (MEMS), a digital micromirror device (DMD), a digital micro shutter (DMS), MIRASOL (registered trademark), an interferometric modulator display (IMOD) element, a MEMS shutter display element, an optical-interference-type MEMS display element, an electrowetting element, a piezoelectric ceramic display, or a carbon nanotube. Note that examples of display devices having EL elements include an EL display. Examples of display devices including electron emitters are a field emission display (FED) and an SED-type flat panel display (SED: surface-conduction electron-emitter display). Examples of display devices including liquid crystal elements include a liquid crystal display (e.g., a transmissive liquid crystal display, a transflective liquid crystal display, a reflective liquid crystal display, a direct-view liquid crystal display, or a projection liquid crystal display). An example of a display device including electronic ink or electrophoretic elements is electronic paper. In the case of a transflective liquid crystal display or a reflective liquid crystal display, some of or all of pixel electrodes function as reflective electrodes. For example, some or all of pixel electrodes are formed to contain aluminum, silver, or the like. In such a case, a memory circuit such as an SRAM can be provided under the reflective electrodes. Accordingly, power consumption can be further reduced.

In this specification and the like, for example, transistors with a variety of structures can be used as a transistor, without limitation to a certain type. For example, a transistor including a single-crystal silicon, or a transistor including a non-single-crystal semiconductor film typified by amorphous silicon, polycrystalline silicon, microcrystalline (also referred to as microcrystal, nanocrystal, or semi-amorphous) silicon, or the like can be used as a transistor. A thin film transistor (TFT) obtained by thinning such a semiconductor can be used. In the case of using the TFT, there are various advantages. For example, since the TFT can be formed at temperature lower than that of the case of using single-crystal silicon, manufacturing cost can be reduced or a manufacturing apparatus can be made larger. Since the manufacturing apparatus is made larger, the TFT can be formed using a large substrate. Therefore, many display devices can be formed at the same time at low cost. In addition, a substrate having low heat resistance can be used because of low manufacturing temperature. Therefore, the transistor can be formed using a light-transmitting substrate. Alternatively, transmission of light in a display element can be controlled by using the transistor formed using the light-transmitting substrate. Alternatively, part of a film included in the transistor can transmit light because the thickness of the transistor is small. Therefore, the aperture ratio can be improved.

Note that when a catalyst (e.g., nickel) is used in the case of forming polycrystalline silicon, crystallinity can be further improved and a transistor having excellent electric characteristics can be formed. Accordingly, a gate driver circuit (e.g., a scan line driver circuit), a source driver circuit (e.g., a signal line driver circuit), and a signal processing circuit (e.g., a signal generation circuit, a gamma correction circuit, or a DA converter circuit) can be formed using the same substrate as a pixel portion.

Note that when a catalyst (e.g., nickel) is used in the case of forming microcrystalline silicon, crystallinity can be further improved and a transistor having excellent electric characteristics can be formed. In this case, crystallinity can be improved by just performing heat treatment without performing laser irradiation. Accordingly, a gate driver circuit (e.g., a scan line driver circuit) and part of a source driver circuit (e.g., an analog switch) can be formed over the same substrate. Note that when laser irradiation for crystallization is not performed, unevenness in crystallinity of silicon can be suppressed. Therefore, high-quality images can be displayed. Note that it is possible to manufacture polycrystalline silicon or microcrystalline silicon without a catalyst (e.g., nickel).

Note that although preferably, crystallinity of silicon is improved to polycrystal, microcrystal, or the like in the whole panel, the present invention is not limited to this. Crystallinity of silicon may be improved only in part of the panel. Selective increase in crystallinity can be achieved by selective laser irradiation or the like. For example, only a peripheral driver circuit region excluding pixels may be irradiated with laser light. Alternatively, only a region of a gate driver circuit, a source driver circuit, or the like may be irradiated with laser light. Alternatively, only part of a source driver circuit (e.g., an analog switch) may be irradiated with laser light. Accordingly, crystallinity of silicon can be improved only in a region in which a circuit needs to be operated at high speed. Since a pixel region is not particularly needed to be operated at high speed, even if crystallinity is not improved, the pixel circuit can be operated without problems. Thus, a region whose crystallinity is improved is small, so that manufacturing steps can be decreased. Thus, throughput can be increased and manufacturing cost can be reduced. Alternatively, since the number of necessary manufacturing apparatus is small, manufacturing cost can be reduced.

Note that for example, a transistor including a compound semiconductor (e.g., SiGe, GaAs, and the like), an oxide semiconductor (e.g., ZnO, InGaZnO, IZO (indium zinc oxide) (registered trademark), ITO (indium tin oxide), SnO, TiO, and AlZnSnO (AZTO)), ITZO (In—Sn—Zn—O) (registered trademark), or the like; a thin film transistor obtained by thinning such a compound semiconductor or an oxide semiconductor; or the like can be used as a transistor. A thin film transistor obtained by thinning such a compound semiconductor or an oxide semiconductor, or the like can be used. Since manufacturing temperature can be lowered, such a transistor can be formed at room temperature, for example. Accordingly, the transistor can be formed directly on a substrate having low heat resistance, such as a plastic substrate or a film substrate. Note that such a compound semiconductor or an oxide semiconductor can be used not only for a channel portion of the transistor but also for other applications. For example, such a compound semiconductor or an oxide semiconductor can be used for a wiring, a resistor, a pixel electrode, a light-transmitting electrode, or the like. Since such an element can be formed at the same time as the transistor, cost can be reduced.

Note that for example, a transistor or the like formed by an inkjet method or a printing method can be used as a transistor. Accordingly, a transistor can be formed at room temperature, can be formed at a low vacuum, or can be formed using a large substrate. Therefore, the transistor can be formed without use of a mask (reticle), so that the layout of the transistor can be easily changed. Alternatively, since the transistor can be formed without use of a resist, material cost is reduced and the number of steps can be reduced. Further, since a film can be formed where needed, a material is not wasted as compared to a manufacturing method by which etching is performed after the film is formed over the entire surface; thus, costs can be reduced.

Note that for example, a transistor or the like including an organic semiconductor or a carbon nanotube can be used as a transistor. Accordingly, such a transistor can be formed using a substrate which can be bent. A device including a transistor which includes an organic semiconductor or a carbon nanotube can resist a shock.

Note that transistors with a variety of different structures can be used as a transistor. For example, a MOS transistor, a junction transistor, a bipolar transistor, or the like can be used as a transistor. By using a MOS transistor as a transistor, the size of the transistor can be reduced. Thus, a large number of transistors can be mounted. With use of a bipolar transistor as the transistor, large current can flow. Thus, a circuit can be operated at high speed. Note that a MOS transistor and a bipolar transistor may be formed over one substrate. Thus, reduction in power consumption, reduction in size, high speed operation, and the like can be realized.

Note that in this specification and the like, for example, a transistor with a multi-gate structure having two or more gate electrodes can be used as a transistor. With the multi-gate structure, a structure where a plurality of transistors are connected in series is provided because channel regions are connected in series. Thus, with the multi-gate structure, the amount of off-state current can be reduced and the withstand voltage of the transistor can be increased (the reliability can be improved).

Alternatively, with the multi-gate structure, drain-source current does not change much even if drain-source voltage changes when the transistor operates in a saturation region, so that a flat slope of voltage-current characteristics can be obtained. By utilizing the flat slope of the voltage-current characteristics, an ideal current source circuit or an active load having an extremely large resistance can be realized. Accordingly, a differential circuit, a current mirror circuit, or the like having excellent properties can be realized.

Note that a transistor with a structure where gate electrodes are formed above and below a channel can be used, for example. With the structure where the gate electrodes are formed above and below the channel, a circuit structure where a plurality of transistors are connected in parallel is provided. Thus, a channel region is increased, so that the amount of current can be increased. Alternatively, by using the structure where gate electrodes are formed above and below the channel, a depletion layer can be easily formed, so that subthreshold swing can be improved.

Note that as a transistor, for example, it is possible to use a transistor with a structure where a gate electrode is formed above a channel region, a structure where a gate electrode is formed below a channel region, a staggered structure, an inverted staggered structure, a structure where a channel region is divided into a plurality of regions, a structure where channel regions are connected in parallel or in series, or the like. A transistor with any of a variety of structures such as a planar type, a FIN-type, a Tri-Gate type, a top-gate type, a bottom-gate type, a double-gate type (with gates above and below a channel), and the like can be used.

Note that in this specification and the like, a transistor can be formed using any of a variety of substrates, for example. The type of a substrate is not limited to a certain type. As the substrate, a semiconductor substrate (e.g., a single crystal substrate or a silicon substrate), an SOI substrate, a glass substrate, a quartz substrate, a plastic substrate, a metal substrate, a stainless steel substrate, a substrate including stainless steel foil, a tungsten substrate, a substrate including tungsten foil, a flexible substrate, an attachment film, paper including a fibrous material, a base material film, or the like can be used, for example. As an example of a glass substrate, a barium borosilicate glass substrate, an aluminoborosilicate glass substrate, a soda lime glass substrate, or the like can be given. Examples of a flexible substrate, a flexible substrate, an attachment film, a base film, or the like are as follows: a plastic typified by polyethylene terephthalate (PET), polyethylene naphthalate (PEN), and polyether sulfone (PES); a synthetic resin such as acrylic; polypropylene; polyester; polyvinyl fluoride; polyvinyl chloride; polyester; polyamide; polyimide; aramid; epoxy; an inorganic vapor deposition film; and paper. Specifically, the use of semiconductor substrates, single crystal substrates, SOI substrates, or the like enables the manufacture of small-sized transistors with a small variation in characteristics, size, shape, or the like and with high current capability. A circuit using such transistors achieves lower power consumption of the circuit or higher integration of the circuit.

Note that a transistor may be formed using one substrate, and then the transistor may be transferred to another substrate. Examples of a substrate to which a transistor is transferred include, in addition to the above-described substrates over which transistors can be formed, a paper substrate, a cellophane substrate, an aramid film substrate, a polyimide film substrate, a stone substrate, a wood substrate, a cloth substrate (including a natural fiber (e.g., silk, cotton, or hemp), a synthetic fiber (e.g., nylon, polyurethane, or polyester), a regenerated fiber (e.g., acetate, cupra, rayon, or regenerated polyester), or the like), a leather substrate, a rubber substrate, and the like. When such a substrate is used, a transistor with excellent properties or a transistor with low power consumption can be formed, a device with high durability, high heat resistance can be provided, or reduction in weight or thickness can be achieved.

Note that all the circuits needed to realize a predetermined function can be formed over the same substrate (e.g., a glass substrate, a plastic substrate, a single crystal substrate, or an SOI substrate). Thus, costs can be reduced by reduction in the number of components, or the reliability can be improved by reduction in the number of connections to circuit components.

Note that it is possible to form not all the circuits needed to realize the predetermined function over the same substrate. That is, a part of the circuits needed to realize the predetermined function can be formed over a substrate and another part of the circuits needed to realize the predetermined function can be formed over another substrate. For example, a part of the circuits needed to realize the predetermined function can be formed over a glass substrate and a part of the circuits needed to realize the predetermined function can be formed over a single crystal substrate (or an SOI substrate). Then, a single crystal substrate over which a part of the circuits needed to realize the predetermined function (such a substrate is also referred to as an IC chip) can be connected to a glass substrate by COG (chip on glass), and an IC chip can be provided on the glass substrate. Alternatively, an IC chip can be connected to a glass substrate using TAB (tape automated bonding), COF (chip on film), SMT (surface mount technology), a printed circuit board, or the like. When some of the circuits are formed using the same substrate as a pixel portion in this manner, cost can be reduced by reduction in the number of components or reliability can be improved by reduction in the number of connections to circuit components. In particular, a circuit with high driving voltage, a circuit with high driving frequency, or the like consumes a large amount of power in many cases. In order to deal with it, such a circuit is formed over a substrate (e.g., a single crystal substrate) which is different from a substrate where the pixel portion is formed, so that an IC chip is formed. By the use of this IC chip, an increase in power consumption can be prevented.

For example, in this specification and the like, an active matrix method in which an active element is included in a pixel or a passive matrix method in which an active element is not included in a pixel can be used.

In an active matrix method, as an active element (a non-linear element), not only a transistor but also various active elements (non-linear elements) can be used. For example, an MIM (metal insulator metal), a TFD (thin film diode), or the like can also be used. Since such an element has few numbers of manufacturing steps, manufacturing cost can be reduced or yield can be improved. Alternatively, since the size of the element is small, the aperture ratio can be improved, so that power consumption can be reduced or higher luminance can be achieved.

As a method other than the active matrix method, the passive matrix method in which an active element (a non-linear element) is not used can also be used. Since an active element (a non-linear element) is not used, the number of manufacturing steps is small, so that manufacturing cost can be reduced or yield can be improved. Alternatively, since an active element (a non-linear element) is not used, the aperture ratio can be improved, so that power consumption can be reduced or higher luminance can be achieved, for example.

This embodiment can be combined with any of the other embodiments in this specification as appropriate.

Embodiment 7

In this embodiment, the structure of a display panel that can be used for a position input portion and a display device of the data processing device of one embodiment of the present invention will be described with reference toFIGS.27A and27BandFIG.28. Note that the display panel described in this embodiment includes a touch sensor (a contact sensor device) that overlaps with a display portion; thus, the display panel can be called a touch panel (an input/output device).

FIG.27Ais a schematic perspective view of a touch panel500described as an example in this embodiment. Note thatFIGS.27A and27Billustrate only main components for simplicity.FIG.27Bis a developed view of the schematic perspective view of the touch panel500.

FIG.28is a cross-sectional view of the touch panel500taken along line X1-X2 inFIG.27A.

The touch panel500includes a display unit501and a touch sensor595(seeFIG.27B). Furthermore, the touch panel500includes a substrate510, a substrate570, and a substrate590. Note that the substrate510, the substrate570, and the substrate each have flexibility, for example.

Note that in this specification and the like, a transistor can be formed using any of a variety of substrates, for example. The type of a substrate is not limited to a certain type. As the substrate, a semiconductor substrate (e.g., a single crystal substrate or a silicon substrate), an SOI substrate, a glass substrate, a quartz substrate, a plastic substrate, a metal substrate, a stainless steel substrate, a substrate including stainless steel foil, a tungsten substrate, a substrate including tungsten foil, a flexible substrate, an attachment film, paper including a fibrous material, a base material film, or the like can be used, for example. As an example of a glass substrate, a barium borosilicate glass substrate, an aluminoborosilicate glass substrate, a soda lime glass substrate, or the like can be given. Examples of a flexible substrate include a flexible synthetic resin such as plastics typified by polyethylene terephthalate (PET), polyethylene naphthalate (PEN), and polyether sulfone (PES), and acrylic. Examples of an attachment film are attachment films formed using polypropylene, polyester, polyvinyl fluoride, polyvinyl chloride, and the like. Examples of the material for the base film include polyester, polyamide, polyimide, inorganic vapor deposition film, and paper. Specifically, the use of semiconductor substrates, single crystal substrates, SOI substrates, or the like enables the manufacture of small-sized transistors with a small variation in characteristics, size, shape, or the like and with high current capability. A circuit using such transistors achieves lower power consumption of the circuit or higher integration of the circuit.

The display portion501includes the substrate510, a plurality of pixels over the substrate510, and a plurality of wirings511through which signals are supplied to the pixels. The plurality of wirings511is led to a peripheral portion of the substrate510, and part of the plurality of wirings511forms a terminal519. The terminal519is electrically connected to an FPC509(1).

<Touch Sensor>

The substrate590includes the touch sensor595and a plurality of wirings598electrically connected to the touch sensor595. The plurality of wirings598is led to a peripheral portion of the substrate590, and part of the plurality of wirings598forms a terminal for electrical connection to an FPC509(2). Note that inFIG.27B, electrodes, wirings, and the like of the touch sensor595provided on the back side of the substrate (on the back side of the diagram) are indicated by solid lines for clarity.

As a touch sensor used as the touch sensor595, a capacitive touch sensor is preferably used. Examples of the capacitive touch sensor are a surface capacitive touch sensor and a projected capacitive touch sensor. Examples of the projected capacitive touch sensor are a self capacitive touch sensor and a mutual capacitive touch sensor, which differ mainly in the driving method. The use of a mutual capacitive type is preferable because multiple points can be sensed simultaneously.

An example of using a projected capacitive touch sensor is described below with reference toFIG.27B. Note that a variety of sensors that can sense the closeness or the contact of a sensing target such as a finger, can be used.

The projected capacitive touch sensor595includes electrodes591and electrodes592. The electrodes591are electrically connected to any of the plurality of wirings598, and the electrodes592are electrically connected to any of the other wirings598.

The electrode592is in the form of a series of quadrangles arranged in one direction as illustrated inFIGS.27A and27B. Each of the electrodes591is in the form of a quadrangle. A wiring594electrically connects two electrodes591arranged in a direction intersecting with the direction in which the electrode592extends. The intersecting area of the electrode592and the wiring594is preferably as small as possible. Such a structure allows a reduction in the area of a region where the electrodes are not provided, reducing unevenness in transmittance. As a result, unevenness in luminance of light from the touch sensor595can be reduced.

Note that the shapes of the electrodes591and the electrodes592are not limited to the above-mentioned shapes and can be any of a variety of shapes. For example, the plurality of electrodes591may be provided so that space between the electrodes591are reduced as much as possible, and a plurality of electrodes592may be provided with an insulating layer sandwiched between the electrodes591and the electrodes592and may be spaced apart from each other to form a region not overlapping with the electrodes591. In that case, between two adjacent electrodes592, it is preferable to provide a dummy electrode which is electrically insulated from these electrodes, whereby the area of a region having a different transmittance can be reduced.

The structure of the touch panel500is described with reference toFIG.28.

The touch sensor595includes the substrate590, the electrodes591and the electrodes592provided in a staggered arrangement on the substrate590, an insulating layer593covering the electrodes591and the electrodes592, and the wiring594that electrically connects the adjacent electrodes591to each other.

An adhesive layer597attaches the substrate590to the substrate570so that the touch sensor595overlaps with the display portion501.

The electrodes591and the electrodes592are formed using a light-transmitting conductive material. As a light-transmitting conductive material, a conductive oxide such as indium oxide, indium tin oxide, indium zinc oxide, zinc oxide, or zinc oxide to which gallium is added can be used.

The electrodes591and the electrodes592may be formed by depositing a light-transmitting conductive material on the substrate590by a sputtering method and then removing an unnecessary portion by any of various patterning techniques such as photolithography.

The insulating layer593covers the electrodes591and the electrodes592. Examples of a material for the insulating layer593are a resin such as acrylic or epoxy resin, a resin having a siloxane bond, and an inorganic insulating material such as silicon oxide, silicon oxynitride, or aluminum oxide.

Furthermore, openings reaching the electrodes591are formed in the insulating layer593, and the wiring594electrically connects the adjacent electrodes591. The wiring594is preferably formed using a light-transmitting conductive material, in which case the aperture ratio of the touch panel can be increased. Moreover, the wiring594is preferably formed using a material that has higher conductivity than those of the electrodes591and the electrodes592.

One electrode592extends in one direction, and a plurality of electrodes592is provided in the form of stripes.

The wiring594intersects with the electrode592.

Adjacent electrodes591are provided with one electrode592provided therebetween and are electrically connected by the wiring594.

Note that the plurality of electrodes591is not necessarily arranged in the direction orthogonal to one electrode592and may be arranged to intersect with one electrode592at an angle of less than 90 degrees.

One wiring598is electrically connected to any of the electrodes591and592. Part of the wiring598serves as a terminal. For the wiring598, a metal material such as aluminum, gold, platinum, silver, nickel, titanium, tungsten, chromium, molybdenum, iron, cobalt, copper, or palladium or an alloy material containing any of these metal materials can be used.

Note that an insulating layer that covers the insulating layer593and the wiring may be provided to protect the touch sensor595.

Furthermore, a connection layer599electrically connects the wiring598to the FPC509(2).

As the connection layer599, any of various anisotropic conductive films (ACF), anisotropic conductive pastes (ACP), or the like can be used.

The adhesive layer597has a light-transmitting property. For example, a thermosetting resin or an ultraviolet curable resin can be used; specifically, a resin such as an acrylic resin, a urethane resin, an epoxy resin, or a resin having a siloxane bond can be used.

(Display Portion)

The touch panel500includes a plurality of pixels arranged in a matrix. Each of the pixels includes a display element and a pixel circuit for driving the display element.

In this embodiment, an example of using an organic electroluminescent element that emits white light as a display element will be described; however, the display element is not limited to such element.

As the display element, for example, other than organic electroluminescent elements, any of a variety of display elements such as display elements (electronic ink) that perform display by an electrophoretic method, an electronic liquid powder method, or the like; MEMS shutter display elements; optical interference type MEMS display elements; and liquid crystal elements can be used. Note that a structure suitable for employed display elements can be selected from among a variety of structures of pixel circuits.

The substrate510is a stacked body in which a flexible substrate510b, a barrier film510athat prevents diffusion of unintentional impurities to light-emitting elements, and an adhesive layer510cthat attaches the barrier film510ato the substrate510bare stacked.

The substrate570is a stacked body in which a flexible substrate570b, a barrier film570athat prevents diffusion of unintentional impurities to the light-emitting elements, and an adhesive layer570cthat attaches the barrier film570ato the substrate570bare stacked.

A sealant560attaches the substrate570to the substrate510. The sealant560, also serving as an optical adhesive layer, has a refractive index higher than that of air. The pixel circuits and the light-emitting elements (e.g., a first light-emitting element550R) are provided between the substrate510and the substrate570.

<<Structure of Pixels>>

A pixel includes a sub-pixel502R, and the sub-pixel502R includes a light-emitting module580R.

The sub-pixel502R includes the first light-emitting element550R and the pixel circuit that can supply electric power to the first light-emitting element550R and includes a transistor502t. Furthermore, the light-emitting module580R includes the first light-emitting element550R and an optical element (e.g., a coloring layer567R).

The first light-emitting element550R includes a lower electrode, an upper electrode, and a layer containing a light-emitting organic compound between the lower electrode and the upper electrode.

The light-emitting module580R includes the first coloring layer567R on the substrate570. The coloring layer transmits light of a particular wavelength and is, for example, a layer that selectively transmits light of red, green, or blue color. A region that transmits light emitted from the light-emitting element as it is may be provided as well.

The light-emitting module580R includes the sealant560that is in contact with the first light-emitting element550R and the first coloring layer567R.

The first coloring layer567R is positioned in a region overlapping with the first light-emitting element550R. Accordingly, part of light emitted from the first light-emitting element550R passes through the sealant560that also serves as an optical adhesive layer and through the first coloring layer567R and is emitted to the outside of the light-emitting module580R as indicated by arrows inFIG.28.

<<Structure of Display Portion>>

The display portion501includes a light-blocking layer567BM on the substrate570. The light-blocking layer567BM is provided so as to surround the coloring layer (e.g., the first coloring layer567R).

The display portion501includes an anti-reflective layer567ppositioned in a region overlapping with pixels. As the anti-reflective layer567p, a circular polarizing plate can be used, for example.

The display portion501includes an insulating film521. The insulating film covers the transistor502t. Note that the insulating film521can be used as a layer for planarizing unevenness due to the pixel circuit. An insulating film on which a layer that can prevent diffusion of impurities to the transistor502tand the like is stacked can be used as the insulating film521.

The display portion501includes the light-emitting elements (e.g., the first light-emitting element550R) over the insulating film521.

The display portion501includes, over the insulating film521, a partition wall that overlaps with an end portion of the first lower electrode. In addition, a spacer that controls the distance between the substrate510and the substrate570is provided on the partition wall528.

<<Structure of Image Signal Line Driver Circuit>>

The image signal line driver circuit503s(1) includes a transistor503tand a capacitor503c. Note that the image signal line driver circuit503s(1) can be formed in the same process and over the same substrate as those of the pixel circuits.

<<Other Structures>>

The display portion501includes the wirings511through which signals can be supplied. The wirings511are provided with the terminal519. Note that the FPC509(1) through which a signal such as an image signal or a synchronization signal can be supplied is electrically connected to the terminal519.

Note that a printed wiring board (PWB) may be attached to the FPC509(1).

This embodiment can be combined with any of the other embodiments in this specification as appropriate.

Embodiment 8

In this embodiment, a method for manufacturing a foldable device that can be used for the data processing device or an electronic device of one embodiment of the present invention will be described with reference toFIGS.29A to29D,FIGS.30A to30D, andFIGS.31A to31D. As examples of the foldable device, a display device, a light-emitting device, an input device, and the like can be given. As examples of the input device, a touch sensor, a touch panel, and the like can be given. As examples of the light-emitting device, an organic EL panel, a lighting device, and the like can be given. As examples of the display device, a light-emitting device, an organic EL panel, a liquid crystal display device, and the like can be given. Note that functions of an input device such as a touch sensor and the like are provided in the display device and or the light-emitting device in some cases. For example, a counter substrate (e.g., a substrate not provided with a transistor) included in the display device or the light-emitting device is provided with a touch sensor in some cases. Alternatively, an element substrate (e.g., a substrate provided with a transistor) included in the display device or the light-emitting device is provided with a touch sensor in some cases. Alternatively, the counter substrate included in the display device or the light-emitting device and the element substrate included in the display device or the light-emitting device are provided with touch sensors in some cases.

First, a separation layer703is formed over a formation substrate701, and a layer705to be separated is formed over the separation layer703(FIG.29A). Furthermore, a separation layer723is formed over a formation substrate721, and a layer725to be separated is formed over the separation layer723(FIG.29B).

Furthermore, in the case of using a tungsten film as a separation layer, a tungsten oxide film can be formed on a surface of the tungsten film by any of the following methods: performing a plasma treatment over the surface of the tungsten film using a gas containing oxygen such as N2O, annealing the tungsten film in a gas atmosphere containing oxygen. Alternatively, a tungsten oxide film can be formed by method such as sputtering in gas atmosphere containing oxygen. In this manner, the oxide tungsten film may be formed between a separation layer and a layer to be separated.

In a separating and transferring process of the tungsten oxide film, it is preferable that the tungsten oxide film be mainly WOxwhose x is smaller than 3. In the case where WOxis WnO(3n-1)or WnO(3n-2), which is a homologous series, shear is easily caused by heating because there is a crystal optical shear plane therein. The tungsten oxide film is formed, so that separation of the layer to be separated from a substrate can be performed with small force.

Alternatively, it is also possible that a tungsten film is not formed and only the tungsten oxide film is formed as the separation layer. For example, the tungsten oxide film may be formed by the following methods: performing a plasma treatment using a gas containing oxygen with respect to a sufficiently thin tungsten film, annealing the sufficiently thin tungsten film in a gas atmosphere containing oxygen. Alternatively, the tungsten oxide film may be formed by a method such as a sputtering method in a gas atmosphere containing oxygen.

Here, when the tungsten oxide film is separated at the interface with the layer to be separated, the tungsten oxide film remains on the layer to be separated side in some cases. When the tungsten oxide film remains, the characteristics of the transistor are adversely affected in some cases. Thus, after a step of separating the separation layer and the layer to be separated, the step of removing the tungsten oxide film is preferably included. In the above method of separating from the substrate, N2O plasma treatment is not necessarily performed, and the step of removing the tungsten oxide film can be omitted. In that case, the device can be manufactured more easily.

Furthermore, in one embodiment of the present invention, a tungsten film with a thickness of greater than or equal to 0.1 nm and less than 200 nm is formed over the substrate.

As the separation layer, a film containing molybdenum, titanium, vanadium, tantalum, silicon, aluminum, or an alloy thereof can be used, besides a tungsten film. Furthermore, it is also possible to use a stack of such a film and an oxide film. The separation layer is not limited to an inorganic film, and an organic film such as polyimide may be used.

In the case of using an organic resin for the separation layer, a process temperature needs to be lower than or equal to 350° C. when polysilicon is used as an active layer of the transistor. Thus, dehydrogenation baking for silicon crystallization, hydrogenation for termination of defects in silicon, or activation of a doped region cannot be performed sufficiently, so that the performance of the transistor is limited. On the other hand, in the case of using an inorganic film, the process temperature can be higher than 350° C., and excellent characteristics of a transistor can be obtained.

In the case of using the organic resin for the separation layer, the organic resin or a functional element is damaged by laser irradiation at the time of crystallization; thus, it is preferable to use an inorganic film for the separation layer because such a problem is not caused.

Furthermore, in the case of using the organic resin for the separation layer, the organic resin shrinks by laser irradiation for separating the resin and contact failure is caused in the contact portion of the terminal of an FPC or the like, which makes it difficult for functional elements with many terminals a high-definition display of FPC, or the like to separate and transpose with high yield. In the case of using an inorganic film for the separation layer, there is no such limitation, and functional elements with many terminals of high-definition display and the like, or the like can be separated and transferred with high yield.

In the method for separating and transferring the functional element from the substrate of one embodiment of the present invention, an insulating film and a transistor can be formed over the formation substrate at a temperature of lower than or equal to 600° C. In that case, a high-temperature polysilicon or CG silicon (registered trademark) can be used for a semiconductor layer. With use of a conventional production line for high-temperature polysilicon or CG silicon (registered trademark), a semiconductor device with a high operation speed, a high gas barrier property, and high reliability can be mass-produced. In that case, with use of the insulating layer and the transistor formed through the process at the temperature of lower than or equal to 600° C., insulating layers having an excellent gas barrier property formed at the temperature of lower than or equal to 600° C. can be provided above and below an organic EL element. Accordingly, entry of impurities such as moisture into the organic EL element or the semiconductor layer can be suppressed, whereby an extraordinarily reliable light-emitting device can be obtained as compared with the case of using the organic resin or the like as the separation layer.

Alternatively, the insulating layer and the transistor can be formed over the formation substrate at 500° C. or lower. In that case, low-temperature polysilicon or an oxide semiconductor can be used for the semiconductor layer, and mass production is possible with use of a conventional production line for low temperature polysilicon. Also in that case, with use of the insulating layer and the transistor formed through the process at the temperature of lower than or equal to 500° C., insulating layers having an excellent gas barrier property formed at the temperature of lower than or equal to 500° C. can be provided above and below the organic EL element. Accordingly, the entry of impurities such as moisture into the inorganic EL element or the semiconductor layer is suppressed, whereby a highly reliable light-emitting device can be obtained as compared with the case of using the organic resin as the separation layer.

Alternatively, the insulating layer and the transistor can be formed over the formation substrate at 400° C. or lower. In that case, amorphous silicon or the oxide semiconductor can be used for the semiconductor layer, and mass production is possible with use of a conventional production line for amorphous silicon. Also in that case, with use of the insulating layer and the transistor formed through the process at the temperature of 400° C. or lower, the insulating layers having an excellent gas barrier property formed at the temperature of 400° C. or lower can be provided above and below the organic EL element. Accordingly, entry of impurities such as moisture into the organic EL element or the semiconductor layer is suppressed, whereby a highly reliable light emitting device can be obtained as compared with a case of using the organic resin and the like as the separation layer.

Next, the formation substrate701and the formation substrate721are attached to each other by using a bonding layer707and a frame-shaped bonding layer711so that the surfaces over which the layers to be separated are formed face each other, and then, the bonding layer707and the frame-shaped bonding layer711are cured (FIG.29C). Here, the frame-shaped bonding layer711and the bonding layer707in a region surrounded by the frame-shaped bonding layer711are provided over the layer725to be separated and after that, the formation substrate701and the formation substrate721face each other and are attached to each other.

Note that the formation substrate701and the formation substrate721are preferably attached to each other in a reduced-pressure atmosphere.

Note that althoughFIG.29Cillustrates the case where the separation layer703and the separation layer723are different in size, separation layers of the same size as illustrated inFIG.29Dmay be used.

The bonding layer707is provided to overlap with the separation layer703, the layer705to be separated, the layer725to be separated, and the separation layer723. Then, an end portion of the bonding layer707is preferably positioned on an inner side of at least an end portion of either the separation layer703or the separation layer723(the separation layer which is desirably separated from the substrate first). Accordingly, strong adhesion between the formation substrate701and the formation substrate721can be suppressed; thus, a decrease in the yield of a subsequent separation process can be suppressed.

Next, a first separation trigger741from the substrate is formed by laser light irradiation (FIGS.30A and30B).

Either the formation substrate701or the formation substrate721may be separated first. In the case where the separation layers differ in size, a substrate over which a larger separation layer is formed may be separated first or a substrate over which a smaller separation layer is formed may be separated first. In the case where an element such as a semiconductor element, a light-emitting element, or a display element is formed only over one of the substrates, the substrate on the side where the element is formed may be separated first or the other substrate may be separated first. Here, an example in which the formation substrate701is separated first is described.

A region where the bonding layer707in a cured state or the frame-shaped bonding layer711in a cured state, the layer705to be separated, and the separation layer703overlap with one another is irradiated with laser light. Here, the bonding layer707is in a cured state and the frame-shaped bonding layer711is not in a cured state, and the bonding layer707in a cured state is irradiated with laser light (see an arrow P3 inFIG.30A).

The first separation trigger741(see a region surrounded by a dashed line inFIG.30B) can be formed by cracking (causing break or crack) at least the first layer (a layer provided between the layer705to be separated and the separation layer703, e.g., a tungsten oxide film). At this time, not only the first layer but also the separation layer703, the bonding layer707, or another layer included in the layer705to be separated may be partly removed.

It is preferable that laser light irradiation be performed from the substrate side provided with the separation layer that is desirably separated. In the case where a region where the separation layer703and the separation layer723overlap with each other is irradiated with laser light, the formation substrate701and the separation layer can be selectively separated by cracking only the layer705to be separated between the layer705to be separated and the layer725to be separated (see a region surrounded by a dotted line inFIG.30B).

When the separation trigger from the substrate is formed in both the layer705to be separated on the separation layer703side and the layer725to be separated on the separation layer723side in the case where the region where the separation layer703and the separation layer723overlap with each other is irradiated with laser light, it might be difficult to selectively separate one of the formation substrates. Therefore, laser light irradiation conditions might be restricted so that only one of the layers to be separated is cracked. The first separation trigger741from the substrate may be formed by a sharp knife such as a cutter, without limitation to the laser light irradiation, or the like.

Then, the layer705to be separated and the formation substrate701are separated from each other from the formed first separation trigger741(FIGS.30C and30D). Accordingly, the layer705to be separated can be transferred from the formation substrate701to the formation substrate721.

The layer705which is separated from the formation substrate701in the step inFIG.30Dis attached to a substrate731with a bonding layer733, and the bonding layer733is cured (FIG.31A).

Next, a second separation trigger743from the substrate is formed by a sharp knife such as a cutter (FIGS.31B and31C). The second separation trigger743from the substrate is formed by the laser light irradiation, without limitation to the sharp knife such as a cutter, or the like.

In the case where the substrate731on the side where the separation layer723is not provided can be cut by a knife or the like, a cut may be made in the substrate731, the bonding layer733, and the layer725to be separated (see arrows P5 inFIG.31B). Accordingly, part of the first layer can be removed; thus, the second separation trigger from the substrate can be formed (see a region surrounded by a dashed line inFIG.31C).

As illustrated inFIGS.31B and31C, in the case where the formation substrate and the substrate731are attached to each other using the bonding layer733in a region not overlapping with the separation layer723, yield of a process for separation from the substrate might be decreased depending on a degree of adhesion between the formation substrate721side and the substrate731side. Therefore, it is preferable to make a cut in a frame shape in a region where the bonding layer733in a cured state and the separation layer723overlap with each other to form the second separation trigger from the substrate in a form of a solid line. Accordingly, the yield of a process for separation from the substrate can be improved.

Then, the layer725to be separated and the formation substrate721are separated from each other from the formed second separation trigger743from the substrate (FIG.31D). Accordingly, the layer725to be separated can be transferred from the formation substrate721to the substrate731.

For example, in the case where the tungsten oxide film, which is tightly anchored by N2O plasma or the like is formed on an inorganic film such as a tungsten film, adhesion can be relatively high in deposition. After that, when a separation trigger is formed, cleavage occurs therefrom, whereby a layer to be separated is easily separated from the formation surface and transferred to another substrate.

The formation substrate721and the layer725to be separated may be separated by filling the interface between the separation layer723and the layer725to be separated with a liquid such as water. A portion between the separation layer723and the layer725to be separated absorbs a liquid through capillarity action, whereby an adverse effect (e.g., a phenomenon in which a semiconductor element is damaged by static electricity) on the functional element such as an FET included in the layer725to be separated due to static electricity caused at the time of separation from the substrate can be suppressed.

When a bond of M-O—W (M represents a given element) is divided by application of physical force, a liquid is absorbed in the separation portion, whereby the bond becomes a bond of M-OH HO—W and the separation is promoted.

Note that a liquid may be sprayed in an atomized form or in a vaporized form. As the liquid, pure water, an organic solvent, or the like can be used; a neutral, alkaline, or acid aqueous solution, an aqueous solution in which salt is dissolved, and the like may be used.

The temperature of the liquid and the substrate at the time of dynamic separation is set in the range from room temperature to 120° C., and preferably set to 60° C. to 90° C.

In the method for separation from the substrate of one embodiment of the present invention described above, separation of the formation substrate is performed in such a manner that the second separation trigger743from the substrate is formed by a sharp knife or the like so that the separation layer and the layer to be separated are made in a state where separating can be easily performed. Accordingly, the yield of the process for separation from substrate can be improved.

In addition, bonding of a substrate with which a device is to be formed can be performed after the following procedure: a pair of formation substrates each provided with the layer to be separated are attached to each other and then, separating each formation substrate is performed. This means that formation substrates having low flexibility can be attached to each other when the layers to be separated are attached to each other. Accordingly, alignment accuracy at the time of attachment can be improved as compared to the case where flexible substrates are attached to each other.

Note that this embodiment can be combined with any of the other embodiments and examples described in this specification as appropriate.

EXPLANATION OF REFERENCE

100: data processing device,101: housing,110: arithmetic unit,111: arithmetic portion,112: memory portion,114: transmission path,115: input/output interface,120: input/output unit,130: display portion,131: keyboard,140: position input portion,141: substrate,142: proximity sensor,145: input/output portion,150: sensor portion,151: sensor,152: arrow,159: sign,160: communication portion,300: input/output unit,301: display portion,302: pixel,308: imaging pixel,309: FPC,310: substrate,311: wiring,319: terminal,321: insulating film,328: partition wall,329: spacer,352: upper electrode,353: layer,354: intermediate layer,360: sealant,370: counter substrate,500: touch panel,501: display portion,509: FPC,510: substrate,511: wiring,519: terminal,521: insulating film,528: partition wall,560: sealant,570: substrate,590: substrate,591: electrode,592: electrode,593: insulating layer,594: wiring,595: touch sensor,597: adhesive layer,598: wiring,599: connection layer,100B: data processing device,120B: input/output unit,130B: display portion,13a: connecting member,13b: connecting member,140(1): region,140(2): region,140(3): region,140(4): region, (5): region,140B: position input portion,140B (1): region,140B (2): region,140B (3): region,15a: supporting member,15b: supporting member,302B: sub-pixel,302G: sub-pixel,302R: sub-pixel,302t: transistor,303c: capacitor,303g(1): scan line driver circuit,303g(2): imaging pixel driver circuit,303s(1): image signal line driver circuit,303s(2): imaging signal line driver circuit,303t: transistor,308p: photoelectric conversion element,308t: transistor,310a: barrier film,310b: substrate,310c: adhesive layer,350R: light-emitting element,351R: lower electrode,353a: light-emitting unit,353b: light-emitting unit,367BM: light-blocking layer,367p: anti-reflective layer,367R: coloring layer,370a: barrier film,370b: substrate,370c: adhesive layer,380B: light-emitting module,380G: light-emitting module,380R: light-emitting module,502R: sub-pixel,502t: transistor,503c: capacitor,503s: image signal line driver circuit,503t: transistor,510a: barrier film,510b: substrate,510c: adhesive layer,550R: light-emitting element,567BM: light-blocking layer,567p: anti-reflective layer,567R: coloring layer,570a: barrier film,570b: substrate;570c: adhesive layer,580R: light-emitting module,701: formation substrate,703: separation layer,705: layer to be separated,707: bonding layer,711: frame-shaped bonding layer,721: formation substrate,723: separation layer,725: layer to be separated;731: substrate,733: bonding layer,741: first separation trigger, and743: second separation trigger.

This application is based on Japanese Patent Application serial no. 2013-248392 filed with Japan Patent Office on Nov. 29, 2013, the entire contents of which are hereby incorporated by reference.