Patent ID: 12248958

DETAILED DESCRIPTION OF THE INVENTION

FIG.1Aillustrates an integrated application flow chart of a social wallet100. The social wallet100can be a social networking web portal and it can typically reside at a cloud based secure server, which can be coupled or integrated with a learning (including relearning) classical/quantum computer. The learning (including relearning) classical computer integrates one or more microprocessors, or one or more neural network based microprocessors, executing computer readable instructions and machine learning algorithm(s), stored on a non-transitory computer readable medium of the cloud based secure server to implement the social wallet100. The social wallet100can connect/access stored information from a data storage (preferably a cloud based secure data storage) component(s)120, can connect/access with information (preferably real time information) from an information source(s) (preferably real time information)140, can connect with a user(s)160, can connect with a merchant(s)180, can connect with a deposit account(s)200, can connect with a payment account(s)220, can connect with an object/array of objects240s, can connect with a node(s)260, can connect with a social wallet electronic module(s)280, can connect with a mobile internet appliance(s)300. Furthermore, the social wallet100can connect/access with a unified algorithm320and connect with the user160via an automated agent/bot (e.g., a chat bot/search bot), enhanced by the unified algorithm320. The user160could type/talk with the social wallet100via the mobile internet appliance300: “Hi, should I renegotiate my car lease?” Instead of a search result, a lease bot enhanced by the unified algorithm320would pop up suggesting a better deal and close it for the user160in exchange for a small commission.

It should be noted that the mobile internet appliance300can be a mobile wearable device, but the mobile wearable device is generally in a smaller form factor with respect to the mobile internet appliance300. Details of the mobile wearable device have been described/disclosed in U.S. Non-Provisional patent application Ser. No. 14/999,601 entitled “SYSTEM AND METHOD OF AMBIENT/PERVASIVE USER/HEALTHCARE EXPERIENCE”, filed on Jun. 1, 2016 (which claims benefit of priority to U.S. Provisional Patent Application No. 62/230,249 entitled “SYSTEM AND METHOD OF AMBIENT/PERVASIVE USER/HEALTHCARE EXPERIENCE”, filed on Jun. 1, 2015).

The unified algorithm320can consist of a software agent340, a fuzzy logic algorithm360, a predictive algorithm380, an intelligence rendering algorithm400and a self-learning (including relearning) algorithm420. It should be noted that the self-learning (including relearning) algorithm420can include a self-learning artificial intelligence algorithm and/or a self-learning neural network algorithm and/or an evolutionary algorithm, and/or a photonic neural learning processor enhanced machine learning algorithm and/or a quantum computer enhanced machine learning algorithm.

An evolutionary algorithm is an evolutionary computation in artificial intelligence. An evolutionary algorithm functions through the (similar to biological) selection process in which the least fit members of the population set are eliminated, whereas the fit members are allowed to survive and continue until better solutions are determined.

In other words, an evolutionary algorithm is a computer application which mimics the natural (biological) evolution in order to solve a complex problem. Over time, the successful members evolve to present the optimized solution to the complex problem. An evolutionary algorithm is a meta-algorithm, an algorithm for designing algorithms—eventually, the algorithms get pretty good at the task, based on three (3) pillars of innovation:1. Meta-learning architectures (resulting in indirect coding),2. Meta-learn learning algorithms (resulting in open ended search),3. Generating effective learning environments (resulting in quality diversity).

The evolutionary algorithm is a class of stochastic search and optimization techniques obtained by natural selection and genetics. It is a population based algorithm by simulating the natural (biological) evolution. Individuals in a population compete and exchange information with one another.

There are three basic genetic operations: selection, crossover and random mutation.

For example, a procedure of an evolutionary algorithm is as follows:

Step 1: Set t=0.

Step 2: Randomize the initial population P(t).

Step 3: Evaluate the fitness of each individual of P(t).

Step 4: Select individuals as parents from P(t+1) based on the fitness.

Step 5: Apply search operators (crossover and mutation) to parents, and generate P(t+1).

Step 6: Set t=t+1.

Step 7: Repeat step 3 to step 6 until the termination criterion is satisfied.

It should be noted that a conventional deep learning algorithm utilizes stochastic gradient descent (SGD), which improves an artificial neural network's over time by gradually reducing errors through an ongoing training with an existing dataset(s)—generally mapping inputs to outputs in known patterns over time, but it may not work properly in reinforcement learning (which is learning how to act/decide with only infrequent feedback signals or unknown outputs for given inputs without any pattern over time).

An artificial neuroevolution algorithm utilizes an evolutionary algorithm (similar to biological Darwinian evolution inspired by nature) with added safe/random mutations to grow/evolve/generate an artificial neural network's layers/rules/topology/parameters for better computing optimized outcomes/results.

Random mutations (may initially degrade an artificial neuroevolution algorithm, before it improves) can allow evolving and reaching a decision toward achieving greater accuracy. Thus, an artificial neuroevolution algorithm can adapt dynamically and intelligently to unknown input signals.

Furthermore, an artificial neuroevolution algorithm can be coupled/connected with a cloud based expert system, as it requires significant computing power of a supercomputer.

Alternatively, an artificial neuroevolution algorithm can be coupled/connected with a quantum computer(s), as it is illustrated in FIGS. 64A-65C of U.S. Non-Provisional patent application Ser. No. 16/602,404 entitled “SYSTEM AND METHOD OF AMBIENT/PERVASIVE USER/HEALTHCARE EXPERIENCE”, filed on Sep. 28, 2019. A quantum computer(s) has essentially an exponential computing power.

A photonic neural learning processor (can be useful for machine learning and/or image/pattern recognition and/or Big Data analysis) can be fabricated/constructed for example, by utilizing a cascaded configuration of interferometers (e.g., Mach-Zehnder type interferometers), 3-db couplers and waveguide based phase shifters. Heat applied to the waveguide base phase shifter(s) can direct light beams to change its shape. It should be noted that interferometer(s) and/or waveguide based phase shifter(s) can be fabricated/constructed, by utilizing a phase transition/phase change material for faster response to an external stimulus (e.g., heat or voltage) and/or integrated with saturable absorbers (e.g., graphene integrated saturable absorber). To reduce thermal cross-talk between the heating elements, thermal isolation trenches can be fabricated/constructed between the heating elements. Alternatively, the photonic neural learning processor can be fabricated/constructed for example as a network(s) of wavelength tunable/selective laser-integrated with an external modulator, when the external modulators are activated by an action of weighted electrical signals (from an array of memristors or by converting optical signals of distinct wavelengths from ring resonators/fast tunable ring resonators (e.g., fast tunable ring resonators incorporating phase transition material thin-film/quantum dot) based add/drop filters). The above network(s) can also utilize a network(s) of optical switches/fast optical switches. It should be noted that the photonic neural learning processor can be a standalone subsystem. Furthermore, various embodiments of system-on-chips/neural networks based system-on-chips have been described/disclosed described in U.S. Non-Provisional patent application Ser. No. 14/999,601 entitled “SYSTEM AND METHOD OF AMBIENT/PERVASIVE USER/HEALTHCARE EXPERIENCE”, filed on Jun. 1, 2016 and the entire contents of this US Non-Provisional Patent Application are incorporated herein. Such a system-on-chip/neural networks based system-on-chip can replace the microprocessor/super-processor and enable cognitive/neural like computing. Such a system-on-chip/neural networks based system-on-chip can integrate the photonic neural learning processor via a network(s) of waveguide, thus enabling a hybrid electrical-photonic neural learning processor.

Alternatively, a photonic neural learning processor can be fabricated/constructed utilizing an array of optically induced phase transition material (e.g., vanadium dioxide (VO2)) based memristors.

At the heart of a quantum computer is a quantum bit (Qubit)—a basic unit of information analogous to a classical bit 0/1 represented by a transistor in a classical computer. The qubit is exponentially more powerful than the classical bit 0/1, because of its two unique properties: it can represent both 1 and 0 at the same time. But for qubit to be useful, it must achieve both quantum superposition (like being in two physical states simultaneously) and quantum entanglement (like what happens to one qubit can instantly affect the other qubit, even when they are physically separated) and these two unique properties can be easily upset by a slightest disturbance (e.g., a material defect/vibration/fluctuating electric fields/noise). Therefore, qubits are extremely susceptible to error, without operating at an extremely low temperature.

However, operational qubits, by utilizing time crystals/implanted color centers (by utilizing silicon or germanium impurity ions) at a precise location on a diamond semiconductor/an array of (atomic force microscopy (AFM) manipulated) triangulene molecules at lower temperature (cooled by a quantum circuit refrigerator) can be possible.

Furthermore, a compact optical configuration can be realized by fabricating/constructing a network of silicon nitride waveguides on top of a substrate (e.g., glass/quartz). The network of silicon nitride waveguides can route light (e.g., light from quantum dot red/green/blue light emitting diodes/lasers or two-dimensional material based light sources). Above the silicon nitride waveguides, a layer (about 1 micron in thickness) of silicon dioxide thin-film or an electrically activated optically tunable material based thin-film can be fabricated/constructed. On top of the silicon dioxide thin-film or electrically activated optically tunable material based thin-film, there are transparent/indium tin oxide/niobium electrodes, integrated with tiny openings in the electrodes to allow light (which is guided via silicon nitride waveguides) to pass through. Beneath the tiny openings in the transparent/indium tin oxide/niobium electrodes, the waveguides in silicon nitride break into a series of sequential ridges to act as diffraction gratings in order to direct light down through the holes and concentrate the light into a beam narrow enough to activate/configure a spin of a color center in a semiconductor substrate.

Furthermore, integration of a surface normal light modulator (e.g., graphene based surface normal spatial light modulator (SLM)) with the diffraction gratings can also be realized.

Triangulene is similar to a fragment of graphene. It is made up of six hexagons of carbon joined along their edges to form a triangle, with hydrogen atoms around the sides.

A quantum computer enhanced machine learning algorithm is an approach that enables a quantum computer to learn/re-learn and to make predictions—by combining machine learning with quantum computation.

A quantum computer enhanced machine learning algorithm can be compiled on one or more microprocessors, or one or more neural network based microprocessors and downloaded onto the quantum computer-classical computer interface for execution. An application of the quantum computer enhanced machine learning algorithm can be hyper personalized advertising. But hyper personalized advertising can be further enhanced by utilizing the quantum computer enhanced machine learning algorithm (or its special case of deep learning algorithm) combined with topological data analysis (TDA).

For example, a machine learning algorithm (or a deep learning algorithm) combined with a topological data analysis (TDA) can enable:Creating an image of data, where every dot is an item or a group of similar items,Spotting patterns in data that would have been impossible to identify using a traditional algorithm(s),Segmenting in data on many levels,Analyzing any data (e.g., texts, images, sound and sensor data),Correlating more complex dependencies in data, andLearning even without supervision.

An example-application of the social wallet100, can allow the user160to get (a) his/her favorite coffee, as he/she approaches a Starbucks without placing an order, or (b) the object/array of objects240scan notify the user160that his/her train is running late, or (c) the object/array of objects240scan turn on room temperature, as the user160approaches his/her home, or (d) the user160can get a relevant coupon(s) (e.g., a movie coupon) with or without an augmented reality (AR) link, when the user160is engaging with an electronic display, where the electronic display is embedded with the object/army of objects240sand/or near-field communication (NFC) tags and/or one-dimensional (1-D)/two-dimensional (2-D) quick response (QR) codes (e.g., a smart poster).

Furthermore, the social wallet100can connect with a location measurement component of the mobile internet appliance(s)300.

The social wallet100can act as an ultimate integrator (e.g., a Trusted Service Manager (TSM)) of many needs of the user160, connecting with other users160sfor various information and needs, transferring information between the other users160s, securely transferring money to the deposit account200(e.g., a bank), securely transferring money to the payment account220(e.g., a bill payment account) and securely transferring money (e.g., a microloan) between the other users160s.

The social wallet100can integrate a blockchain, instead of the Trusted Service Manager. A blockchain is a global distributed ledger/database running on millions of devices and open to anyone, where not just information, but anything of value. In essence it is a shared, trusted public ledger that everyone can inspect, but which no single user controls. A blockchain creates a distributed document of (outputs/transactions) in the form of a digital ledger, which can be available on a network of computers/mobile internet devices300s. When a transaction happens, the users160spropose a record to the ledger. Records are bundled into blocks (groups for processing) and each block receives a unique fingerprint derived from the records it contains. Each block includes the fingerprint of the prior block, creating a robust and unbreakable chain. It is easy to verify the integrity of the entire chain and nearly impossible to falsify historic records. In summary, a blockchain is a public ledger of transactions, which critically provides trust, based upon mathematics rather than human relationships/institutions. A blockchain can replace the historically designed Trusted Service Manager.

Additionally, a blockchain can be integrated with the object/array of objects240sand/or near-field communication tags and/or one-dimensional/two-dimensional quick response codes and such integration with a blockchain can build trust, reduce cost and accelerate smart (automated)transaction.

FIG.1Billustrates steps from4001to4025. In step4001, the social wallet100can connect/access stored information from the data storage (preferably the cloud based secure data storage) component(s)120. In step4002, the social wallet100can connect/access to the information source (preferably real time information)140.

In step4003, the social wallet100can connect to the user160via a profile. In step4004, the social wallet100can connect to the user160via online/offline message. In step4005, the social wallet100can connect to the user160via chat message. In step4006, the social wallet100can connect to the user160via broadcast message. In step4007, the social wallet100can connect to the user160via like/dislike vote. In step4008, the social wallet100can connect to the other users160sfor a collaborative purchase of a product and/or service (wherein the product and/or service can be coupled with a blockchain. For example, a car's parts, manufacturing, servicing, ownership and entire history can be coupled with the blockchain, creating trust between the user160and the merchant180and eliminating services provided by others).

In step4009, the social wallet100can connect to the merchant180via profile. In step4010, the social wallet100can connect to the merchant180via online/offline message. In step4011, the social wallet100can connect to the merchant180via chat message. In step4012, the social wallet100can connect to the merchant180via broadcast message. In step4013, the social wallet100can connect to the merchant180via bid. In step4014, the social wallet100can connect to the merchant180for price of the product or the service via bid in real time.

Furthermore, the bid/bid of the product or the service in real time can be based on game theory/algorithmic game theory/evolutionary game theory, wherein game theory/algorithmic game theory/evolutionary game theory can be coupled with fuzzy logic (or neuro-fuzzy logic) and/or Monte Carlo method and/or Markov method. In game theory, the users160sand the merchants180sbecome players, when their respective decisions coupled with the decisions made by other players, produce an outcome/output. The options available to players to bring about particular outcomes are called as strategies, which are linked to outcomes/outputs by a mathematical function that specifies the consequences of the various combinations of strategy choices by the all players in a game. A coalition refers to the formation of sub-sets of players' options under coordinated strategies. In game theory, the core is the set of feasible allocations that cannot be improved upon by a coalition. An imputation X={x1, x2. . . xn} is in the core of an n-person game if and only if for each subset, S of N:

∑i=1nxi≥V⁡(S)
where V(s) is the characteristic function V of the subset S indicating the amount (reward) that the members of S can be sure of receiving, if they act together and form a coalition (or the amount of S can get without any help from players who are not in S). Above equation states that an imputation x is the core (that X is undominated), if and only if for every coalition S, the total of the received by the players in S (according to X) is at least as large a V(S). The core can also be defined by the equation below as the set of stable imputations:

C:{x=(x1,…,xn):∑i∈Nxi=V⁡(N)⁢and⁢⁢∑i∈Sxi≥V⁡(S),∀S⊂N}
The imputation x is unstable through a coalition S, if the equation below is true, otherwise is stable.

V⁡(S)>∑i∈Sxi
The core can consist of many points. The size of the core can be taken as a measure of stability or how likely a negotiated agreement is prone to be upset. To determine the maximum penalty (cost) that a coalition in the network can be sure of receiving, the linear programming problem represented by the equation below can be used, when maximize

x1+x2+x3+……+xn∑i∈Cxi≤V⁡(C)⁢∀C⊂N
subject to (x1, x2, . . . , xn)≥0 Thus, as outlined above, a game theory based algorithm can account for any conflict in price negotiation. An example of the user160and N merchants180sis described here. Using descending price [second price] for the product or service, the price starts high and continues to fall until one merchant180is left. Using ascending price [first price] for the product and/or service, the price starts low and continues to increase until one merchant180accepts. The user160can also suggest a price for the product and/or service to N merchants180sin a time period and buy from the merchant180, who accepts the user160's bid. The number of bidding rounds is determined by how frequently the user160can make an offer.

A set of instructions based fuzzy logic can be implemented as follows: (a) define linguistic variables and terms, (b) construct membership functions, (c) construct rule base, (d) convert crisp inputs into fuzzy values, utilizing membership functions (fuzzification), (e) evaluate rules in the rule base (inference), (f) combine the results of each rules (inference) and (g) convert outputs into non-fuzzy values (de-fuzzification).

Neuro-fuzzy logic integrates both artificial neural networks and fuzzy logic. Neuro-fuzzy logic can utilize fuzzy inference engine (with fuzzy rules for uncertainties) which is enhanced by artificial neural networks.

It should be noted that price can include brand value, resale value, warranty, delivery time, service contract, return policy and a value-added service(s).

Alternatively, the user can name his/her own price (wherein the price can include brand value, resale value, warranty, delivery time, service contract, return policy and a value-added service(s)) via conjoint analysis tool and relevant data bases coupled with the social wallet100.

Alternatively, a back-and-forth negotiation until the user160and the merchant180reach a mutually agreeable price can be realized by a software (intelligent) agent, wherein the software agent is coupled with the social wallet100.

In step4015, the user160can deposit money (electronic scan of a money order and/or a check) and/or legally approved electronic cash (e.g., Bitcoins, digital gold currency and webmoney with traceable serial numbers) to the deposit account200via the social wallet100. In step4016, the user160can withdraw money from the deposit account200via the social wallet100.

In step4017, the user160can pay money to the payment account220via the social wallet100. In step4018, the user160can transfer/consolidate many payment accounts to the payment account220via the social wallet100.

In step4019, the user160can transfer money (e.g., a microloan) to the other users160svia the social wallet100. In step4020, the social wallet100can communicate with the object240.

Furthermore, the objects240s, near-field communication tags and/or one-dimensional/two-dimensional quick response codes can be embedded on an electronic display

Such communication with the objects240sand/or near-field communication tags and/or one-dimensional/two-dimensional quick response codes can generate loyalty points in real time and can create personalized customer loyalty program, when they are connected with the social wallet100.

In step4021, the social wallet100can communicate with the node260. Furthermore, the node260can communicate with the object/array of objects240s.

In step4022, the social wallet100can communicate with the social wallet electronic module280.

In step4023, the social wallet100can communicate with the mobile internet device300.

In step4024, the social wallet100can communicate with the unified algorithm320. The unified algorithm320can consist of a software agent340, a fuzzy logic algorithm360, a predictive algorithm380, an intelligence rendering algorithm400and a self-learning (including relearning) algorithm420. In step4025, a software agent340, a fuzzy logic algorithm360, a predictive algorithm380, an intelligence rendering algorithm400and a self-learning (including relearning) algorithm420can communicate or couple with the said algorithms.

The intelligent rendering algorithm400can include algorithms such as: artificial intelligence, data interpretation, data mining, machine vision, natural language processing, neural network, pattern recognition and reasoning modeling.

Additionally, a neural network can approximate a function, but it is impossible to interpret the result in terms of a natural language. But an integration of the neural network and fuzzy logic in a neuro-fuzzy algorithm can provide both learning and readability. The neuro-fuzzy algorithm can use a fuzzy inference engine (with fuzzy rules) for modeling uncertainties, which is further enhanced through learning the various situations with a radial basis function. The radial basis function consists of an input layer, a hidden layer and an output layer with an activation function of hidden units. A normalized radial basis function with unequal widths and equal heights can be written as:

ψi(x)⁢(softmax)=exp⁡(hi)∑i=1nexp⁡(hi)hi=(-∑l=12(xl-uil)22⁢σi2)
X is the input vector, uil is the center of the ith hidden node (i=1, . . . , 12) that is associated with the lth (l=1, 2) input vector, σi is a common width of the ith hidden node in the layer and softmax (hi) is the output vector of the ith hidden node. The radial basis activation function is the softmax activation function. First, the input data is used to determine the centers and the widths of the basis functions for each hidden node. Second, is a procedure to find the output layer weights that minimize a quadratic error between predicted values and target values. Mean square error can be defined as:

MSE=1N⁢∑k=1N((TE)kexp-(TE)kcal)2

FIG.2(A, B, C, D, E, F and G) illustrates a method flow chart of integration of the social wallet (the social networking web portal)100and electronic commerce in the following steps:

In step4026, the user160can log into the social wallet100. In step4027, the user160can set a privacy control in the social wallet100. In step4028, the user160can input his/her profile (e.g., gender, age group, income range, zip code, family members/friends' contacts) in the social wallet100.

In step4029, the unified algorithm320in the social wallet100can estimate the personal score of the user160by analyzing the profile, message history, chat history and data patterns (including purchase patterns). In step4030, the unified algorithm320in the social wallet100can set the personal score of the user160. The personal score of the user160can vary with time. In step4031, the social wallet100can record the personal score of the user160over time.

In step4032, the user160can authenticate in the social wallet100, by utilizing multi-level passwords and personalized questions. In step4033, the user160can authenticate in the social wallet100, by placing the social wallet electronic module280, at proximity to the near-field communication terminal (e.g., the near-field communication terminal of a computer/point-of-sale terminal) or by placing the mobile internet device300, at proximity to the near-field communication terminal (e.g., the near-field communication terminal of a computer/point-of-sale terminal), where the mobile internet device300also integrates the social wallet electronic module280. It should be noted that by placing the social wallet electronic module280at proximity to the near-field communication terminal of a computer, the social wallet100/social wallet electronic module280/user160's profile/user160can be securely authenticated. Details of such secure authentication have been described/disclosed in U.S. Non-Provisional patent application Ser. No. 14/999,601 entitled “SYSTEM AND METHOD OF AMBIENT/PERVASIVE USER/HEALTHCARE EXPERIENCE”, filed on Jun. 1, 2016 (which claims benefit of priority to U.S. Provisional Patent Application No. 62/230,249 entitled “SYSTEM AND METHOD OF AMBIENT/PERVASIVE USER/HEALTHCARE EXPERIENCE”, filed on Jun. 1, 2015),

In step4034, the user160can also link the information about the product and/or service with or without an augmented reality link in the social wallet100.

Alternatively, in step4035, the user160can write a wanted ad for the product and/or service in the social wallet100.

In step4036, the unified algorithm320in the social wallet100can determine the location of the user160in real time by communicating with a location measurement component/miniature electronic module1440of the mobile internet device300of the user160.

In step4037, the unified algorithm320(in particular the software agent340) in the social wallet100can send out queries to the location specific merchants180sfor the product and/or service, wanted by the user160. If no offers from the location specific merchants180sare found, then in step4038, the unified algorithm320can send out queries to the location specific merchants in an increment of some distance (e.g., 20 Km) from the current location of the user160in order to secure the product and/or service, wanted by the user160.

In step4039, the unified algorithm in the social wallet100can forward the offers (e.g., in the form of a text/e-mail link/picture mail/video mail) with or without an augmented reality link from the merchants180sinto the mobile internet device300of the user160, in real time (preferably via the user160's profile in the social wallet100).

In step4040, the user160can optionally share the offers from the merchants180swith the mobile internet devices300sof the other users160s, who are connected with the profile of the user160, in real time (preferably via the other users160s′ profiles in the social wallet100).

In step4041, the other users160s′ connected with the profile of the user160vote for like/dislike vote (like quorum sensing). In step4042, the user160can connect with the other users160sfor the collaborative purchase. In step4043, the unified algorithm320in the social wallet100can input the result of the like/dislike vote, in real time. In step4044, the unified algorithm320in the social wallet100can estimate a merchant score of the merchant180by analyzing many like/dislike votes.

Like (e.g., based on price, warranty, delivery time, service contract, return policy and a value-added service(s)) or dislike (e.g., based on price, warranty, delivery time, service contract, return policy and a value-added service(s)) votes can be computed by an algebraic equation (e.g., Fraction Likes=Number Like Votes/(Number Like Votes+Number Dislikes Votes). For example, if the Fraction Likes is below 0.2, then the merchant score is one star, if Fraction Likes is at least 0.2 but less than 0.4, then the merchant score is two stars and so on, if Fraction Likes is more than 0.8, then the merchant score is five stars.

Alternatively, the merchant score can be determined by (a) a statistical method (e.g., like/dislike vote distribution within segments of the users160s) or a statistical method coupled with conjoint analysis (b) a quorum sensing clustering (QSC) algorithm or (c) a quorum sensing molecule (QSM) algorithm.

Quorum sensing is a biological process, by which a community of bacteria interacts and coordinates with neighboring bacteria locally with no awareness of global information. In quorum sensing, bacteria do not communicate with each other directly, yet they influence and sense from a local environment, which assures local decision making optimization simultaneously. As an example of quorum sensing based decision making, assuming the number of users160sis N in number and the user160has one of the two options (like (X) or dislike (Y)) with a constant probability r per time step. Probability r is independent of any actions taken by other users160s. If the user160makes an option X, without the other users160s, then the probability is aPxfor option X and similarly, aPyfor option Y. But, if the user160makes an option, wherein the other users160sare present, then the probability is denoted as Px[a+(m−a)*{xk/(Tk+xk)}], wherein “a” and “m” are minimum and maximum probability respectively for making an option. T is the quorum threshold at which the above probability is halfway between “a” and “m”. “k” determines the steepness of Px[a+(m−a){xk/Tk+xk)}]. If k is equal to 1, then the user160making an option is proportional to the number of the users160swho made that option. If k is greater than 1, then Px[a+(m−a)*{xk/(Tk+xk)}] can act as a step-like switch at the threshold T.

Quorum sensing enables a clustering algorithm. The quorum sensing clustering algorithm can define a cluster as a local region, where density is high and continually distributed. Thus, the quorum sensing clustering algorithm is capable of clustering datasets that are not linearly separable. By mimicking quorum sensing, the quorum sensing clustering algorithm can be decentralized, so that it is suitable for high speed parallel and distributed computing. Quorum sensing can enable a self-learning algorithm (inspired by a dynamic biological process), which can be immune to noise and outliers.

The quorum sensing molecule algorithm is at least based on non-linear dynamics observed at a population scale of a nodei, calculating quorum sensing level/information sharing at the nodeiand then making use of the nodei's quorum sensing level/information to calculate/influence the level/information at neighboring nodes such as, nodej. . . nodek.

The merchant score of the merchant180can vary over time. However, trust can be a critical element in influencing the user160's decision making process. It represents the level of trust that the user160has toward recommending the merchant180. A trust based recommendation system (e.g., based on game theory) can be coupled with the social wallet100. The trust based recommendation system can incorporate:Analyzing similarity in knowledge and preferences between the users160sin order to promote some liking and penalize some disliking,Analyzing recent liking or disliking of users160sin active status,Evaluating the user160sdemographic information and/or habits.

In step4045, the social wallet100can record the merchant score. In step4046, the social wallet100can display the merchant score of the merchant180.

Furthermore, in step4047, if the estimated personal score of the user160exceeds a certain pro-determined value set by the social wallet100, then in step4048, the unified algorithm320(in particular the fuzzy logic algorithm360) in the social wallet100can determine other relevant products and/or services for the user160. In step4049, the social wallet100can send a coupon(s) (e.g., in the form of a text/e-mail link/picture mail/video mail) with or without an augmented reality link for the other relevant products and/or services from the merchants180sto the mobile internet device300of the user160, in real time. In step4050, the user160can share the coupon(s) with the other users160sby simply forwarding the coupon(s) to the other users160s′ mobile internet devices300s, in real time (preferably via the other users160s′ profiles in the social wallet100).

In step4051, the user160can pay for the product and/or service via the social wallet100, or by the social wallet electronic module280, or by the mobile internet device300. The payment via the social wallet100, or by the social wallet electronic module280, or by the mobile internet device300can be coupled with a blockchain.

Furthermore, in step4052, the unified algorithm320(in particular the predictive algorithm380) in the social wallet100can initially determine a set of relevant users for a targeted advertisement for a specified product and/or service.

In step4053, the unified algorithm320in the social wallet100can send a coupon(s) (e.g., in the form of a text/e-mail link/picture mail/video mail) with or without an augmented reality link related to the specified product and/or service from the merchants180sto the profiles of the above set of relevant users160s.

In step4054, the above set of relevant users can share the coupon(s) (e.g., in the form of a text/e-mail link/picture mail/video mail) related to the specified product and/or service from the merchants180swith the other users160s′ mobile internet devices300s, in real time (preferably via the other users160s′ profiles in the social wallet100).

If a targeted advertisement campaign does not receive a response greater than at a pre-determined % (e.g., 10%), then in step4055, the unified algorithm320(in particular the predictive algorithm380, the intelligence rendering algorithm400and the self-learning (including relearning) algorithm420) in the social wallet100can iterate (fine-tune) to find another set of relevant users for the targeted advertisement, until the targeted advertisement would be concluded successful to stop, when the targeted advertisement campaign receives the response greater than at the pre-determined % (e.g., 10%).

Example A: Method Flow Chart from the User160's Perspective

Any example in the above disclosed specifications is by way of an example only and not by way of any limitation (including following steps)(a): A computer implemented method incorporating: accessing, by the mobile internet device300or a mobile wearable internet device of the user160, via a wired or a wireless network, the social wallet100(e.g., a web portal) enabled by a learning or relearning classical computer, or a learning or relearning optical computer, or a learning or relearning quantum computer, wherein the social wallet100includes at least the user160's profile, wherein the learning or relearning classical computer is one or more cloud computers, or premise computers, or mobile computers, wherein the learning or relearning classical computer includes one or more first microprocessors, or one or more first neural network based microprocessors, executing computer readable instructions and one or more machine learning algorithms (wherein the one machine learning algorithm comprises an evolutionary algorithm), stored on a non-transitory computer readable medium to implement the social wallet100, wherein the learning or relearning optical computer includes one or more photonic neural learning processor, wherein the one photonic neural learning processor includes (i) optically induced phase transition material based memristors, or (ii) one or more optical waveguides, or one or more optical emitter systems, wherein the one optical emitter system is activated by weighted optical signals or weighted electrical signals, executing one or more machine learning algorithms to implement the social wallet100, wherein the learning or learning quantum computer includes one or more quantum bits (qubits), executing quantum computer enhanced algorithms or machine learning algorithms to implement the social wallet100, wherein the mobile internet device300or the mobile wearable internet device of the user160includes a wired connector or a wireless transceiver, wherein the mobile internet device300or the mobile wearable internet device of the user160further includes a second microprocessor, or a second neural network based microprocessor, wherein the mobile internet device300or the mobile wearable internet device of the user160is physically, or wirelessly communicatively coupled to the social wallet electronic module280of the user160, wherein the social wallet electronic module230of the user160electrically couples with the second microprocessor, or the second neural network based microprocessor of the mobile internet device300or the mobile wearable internet device of the user160, or the social wallet electronic module280of the user160includes a third microprocessor, or a microcontroller, wherein the social wallet electronic module280of the user160further includes a near-field communication component and a biometric sensor, wherein the mobile internet device300or the mobile wearable internet device of the user160accessing the social wallet100, wherein the said accessing the social wallet100includes obtaining a first biometric scan of the user160from the biometric sensor of the social wallet electronic module280of the user160, storing the first biometric scan of the user160, obtaining a second biometric scan of the user160from the biometric sensor of the social wallet electronic module280of the user160, wherein the second biometric scan of the user160is a current biometric scan of the user160, comparing the first biometric scan of the user160with the second biometric scan of the user160to authenticate the user160, or the social wallet electronic module280of the user160.(b): In response to at least (a), listing or linking, by the user160, a product or a service for purchase on the user160's profile in the social wallet100, wherein the product or the service is linked with augmented reality.(c): In response to at least (a) and (b), automatically determining, by the social wallet100, that the user160is interested in purchasing the product or the service.(d): In response to at least (a), (b) and (c), automatically determining, by the social wallet100, a near real time location of the user160, wherein the near real time location of the user160is detected by a location measurement module of the mobile internet device300or the mobile wearable internet device of the user160, wherein the location measurement module may be selected from a group of a radio frequency identification module, a Bluetooth module, a WiFi module, a global positioning system module and indoor positioning system (IPS) module.(e): In response to at least (a), (b), (c) and (d), automatically querying, by the social wallet100, queried merchants180s(e.g., the sellers) offering to sell the product or the service.(f): In response to at least (a), (b), (c), (d) and (e), automatically selecting, by the social wallet100, one of the queried merchant180, as a selected merchant180of the product or the service to purchase the product or the service, based on a distance from the near real time location of the user160.(g): In response to at least (a), (b), (c), (d), (e) and (f), automatically connecting, by the social wallet100, the user160with the selected merchant180.(h): In response to at least (a), (b), (c), (d), (e), (f) and (g), automatically forwarding, by the social wallet180, to the mobile internet device300or the mobile wearable internet device of the user160, in near real time, one or more sale offers to purchase the product or the service, from the selected merchant180.(i): In response to at least (a), (b), (c), (d), (e), (f), (g) and (h), automatically accepting, by the social wallet180, like votes and dislike votes for the queried merchant from the users160s.(j): In response to at least (a), (h), (c), (d), (e), (f), (g), (h) and (i), automatically determining, a number of the like votes and a number of the dislike votes, further automatically determining, the merchant score for the queried merchant, based on the number of the like votes and the number of the dislike votes by an algebraic equation or a statistical method or a statistical method coupled with conjoint analysis or an algorithm based on quorum sensing.(k): In response to at least (a), (b), (c), (d), (e), (f), (g), (h), (i) and (j), automatically displaying, the merchant score for the queried merchant180.(l): In response to at least (a), (b), (c), (d), (e), (f), (g), (h), (i), (j) and (k), automatically (optionally) sending, by the social wallet100, to the mobile internet device300or the mobile wearable internet device of the user160, a coupon(s) for purchasing an additional product or service from the queried merchant(s)180.(m): In response to at least in response to at least (a), (b), (c), (d), (e), (f), (g), (h), (i), (j), (k) and (l), the selected merchant of the product or the service negotiating a price for the product or the service with the user160, or the user160picking his or her own price.(l): In response to at least (a), (b), (c), (d), (e), (f), (g), (h), (i), (j), (k), (l) and (m), automatically accepting, by the social wallet100, payment by the user160for the product or the service, using the social wallet100, or the user160's profile, or the near-field communication component of the social wallet electronic module280of the user160, based on one or more forwarded sale offers from the queried merchant(s)180.It should be noted that the learning or relearning classical computer can be coupled with the learning or relearning optical computer and/or the learning or relearning quantum computer. However, the learning or relearning classical computer can be integrated with the learning or relearning optical computer on a wafer (substrate) level, utilizing optical waveguides on the wafer (substrate).Wherein the said method steps in (a), (b), (c), (d), (e), (f), (g), (h), (i), (j), (l), (m) and (n) are, at least an ordered combination or in an ordered sequence.The above method further incorporating the social wallet100, which is receiving a first input data from one or more sensors or a second input data from the users160s.The above method further incorporating a set of instructions based on topological data analysis (TDA).The above method further incorporating the social wallet100, which is coupled with one or more automated agents or bots.The above method further incorporating the merchant score, wherein the merchant score is coupled with a trust based recommendation system.The above method further incorporating the product or the service, wherein the product or the service or a service contract is coupled with a blockchain, wherein the block chain may be coupled with the social wallet100.The above method further incorporating the social wallet100, wherein the social wallet100is receiving a third input data from the near-field communication tag, or the quick response code, or the object(s)240.The above method further incorporating the social wallet100, wherein the user160is paying for the product or the service by transferring a currency or a check between the users160sor between the user(s)160sand the merchant(s)180s.

The above method flow chart can be incorporated as a functional system.

Example B: Method Flow Chart from the Merchant180's Perspective

Any example in the above disclosed specifications is by way of an example only and not by way of any limitation (including following steps)

The above method flowchart can be reversed, when the merchant180is a seller, when he/she is listing/linking the product or service to sell and looking for the users160s(the buyers) in the increment of location distance with respect to the location distance of the merchant180.(a): A computer implemented method incorporating: accessing, by the mobile internet device300or a mobile wearable internet device of the user160, via a wired or a wireless network, the social wallet100(e.g., a web portal) enabled by a learning or relearning classical computer, or a learning or relearning optical computer, or a learning or relearning quantum computer, wherein the social wallet100includes at least the user160's profile, wherein the learning or relearning classical computer is one or more cloud computers, or premise computers, or mobile computers, wherein the learning or relearning classical computer includes one or more first microprocessors, or one or more first neural network based microprocessors, executing computer readable instructions and one or more machine learning algorithms (wherein the one machine learning algorithm comprises an evolutionary algorithm), stored on a non-transitory computer readable medium to implement the social wallet100, wherein the learning or relearning optical computer includes one or more photonic neural learning processor, wherein the one photonic neural learning processor includes (i) optically induced phase transition material based memristors, or (ii) one or more optical waveguides, or one or more optical emitter systems, wherein the one optical emitter system is activated by weighted optical signals or weighted electrical signals, executing one or more machine learning algorithms to implement the social wallet100, wherein the learning or learning quantum computer includes one or more quantum bits (qubits), executing quantum computer enhanced algorithms or machine learning algorithms to implement the social wallet100, wherein the mobile internet device300or the mobile wearable internet device of the user160includes a wired connector or a wireless transceiver, wherein the mobile internet device300or the mobile wearable internet device of the user160further includes a second microprocessor, or a second neural network based microprocessor, wherein the mobile internet device300or the mobile wearable internet device of the user160is physically, or wirelessly communicatively coupled to the social wallet electronic module280of the user160, wherein the social wallet electronic module280of the user160electrically couples with the second microprocessor, or the second neural network based microprocessor of the mobile internet device300or the mobile wearable internet device of the user160, or the social wallet electronic module280of the user160includes a third microprocessor, or a microcontroller, wherein the social wallet electronic module280of the user160further includes a near-field communication component and a biometric sensor, wherein the mobile internet device300or the mobile wearable internet device of the user160accessing the social wallet100, wherein the said accessing the social wallet100includes obtaining a first biometric scan of the user160from the biometric sensor of the social wallet electronic module280of the user160, storing the first biometric scan of the user160, obtaining a second biometric scan of the user160from the biometric sensor of the social wallet electronic module280of the user160, wherein the second biometric scan of the user160is a current biometric scan of the user160, comparing the first biometric scan of the user160with the second biometric scan of the user160to authenticate the user160, or the social wallet electronic module280of the user160.(b): In response to at least (a), listing or linking, by the merchant180, a product or a service for sale on the merchant's180's profile in the social wallet100, wherein the product or the service is linked with augmented reality.(c): In response to at least (a) and (b), automatically determining, by the social wallet100, that the users160s, who may be interested in purchasing the product or the service, listed or linked by the merchant180on the merchant's180's profile in the social wallet100.(d): In response to at least (a), (b) and (c), automatically determining, by the social wallet100, a near real time location of the (interested) users160s, wherein the near real time locations of the (interested) users160sare detected by location measurement modules of the mobile internet devices300sor the mobile wearable internet devices of the (interested) users160s, wherein the location measurement module may be selected from a group of a radio frequency identification module, a Bluetooth module, a WiFi module, a global positioning system module and indoor positioning system (IPS) module.(e): In response to at least (a), (b), (c) and (d), automatically connecting, by the social wallet100, the (interested) users160swith the merchant180.(f): In response to at least (a), (b), (c), (d) and (e), automatically accepting, by the social wallet180, like votes and dislike votes for the merchant from the users160s.(g): In response to at least (a), (b), (c), (d), (e) and (f), automatically determining, a number of the like votes and a number of the dislike votes, further automatically determining, the merchant score for the merchant, based on the number of the like votes and the number of the dislike votes by an algebraic equation or a statistical method or a statistical method coupled with conjoint analysis or an algorithm based on quorum sensing.(h): In response to at least (a), (b), (c), (d), (e), (f) and (g), automatically displaying, the merchant score for the queried merchant180.(i): In response to at least (a), (b), (c), (d), (e), (f), (g) and (h), automatically (optionally) sending, by the social wallet100, to the mobile internet devices300sor the mobile wearable internet devices of the users160s, a coupon(s) for purchasing an additional product or service from queried merchant(s)180.(j): In response to at least in response to at least (a), (b), (c), (d), (e), (f), (g), (h) and (i), the merchant of the product or the service negotiating a price for the product or the service with the users160s, or the users160spicking their own prices.(k): In response to at least (a), (b), (c), (d), (e), (f), (g), (h), (i) and (j), automatically accepting, by the social wallet100, payment by the user160for the product or the service, using the social wallet100, or the user160's profile, or the near-field communication component of the social wallet electronic module280of the user160, based on one or more forwarded sale offers from the merchant180.Wherein the said method steps in (a), (b), (c), (d), (e), (f), (g), (h), (i), (j) and (k), are, at least an ordered combination or in an ordered sequence.The above method further incorporating the social wallet100, which is receiving a first input data from one or more sensors or a second input data from the users160s.The above method further incorporating a set of instructions based on topological data analysis (TDA).The above method further incorporating the social wallet100, which is coupled with one or more automated agents or bots.The above method further incorporating the merchant score, wherein the merchant score is coupled with a trust based recommendation system.The above method further incorporating the product or the service, wherein the product or the service or a service contract is coupled with a blockchain, wherein the block chain may be coupled with the social wallet100.The above method further incorporating the social wallet100, wherein the social wallet100is receiving a third input data from the near-field communication tag, or the quick response code, or the object(s)240.The above method further incorporating the social wallet100, wherein the user160is paying for the product or the service by transferring a currency or a check between the users160sor between the user(s)160sand the merchant(s)180s.

The above method flow chart can be incorporated as a functional system.

FIG.2Gillustrates how the social wallet electronic module280and/or mobile internet device300can communicate symmetrically with the social wallet100, by utilizing a controller, a user interface layer, a user profile management layer, an encryption management layer, a protocol management layer and a communication management layer.

The Trusted Service Manager can consolidate/integrate/simplify various services with service providers (e.g., banks, phone companies and service providers).

FIG.2Hillustrates how the social wallet100can function as the Trusted Service Manager to enable social electronic commerce, by utilizing the social wallet electronic module280and/or the mobile internet device300. The Trusted Service Manager can be coupled with various service providers such as: banks, phone companies and service providers.

FIG.3Aillustrates a block diagram of the social wallet electronic module280(preferably in a small form factor e.g., a SD/mini SD).

An external universal serial bus port440can connect with a universal serial bus (USB) connector460. The universal serial bus connector460can be electrically coupled with a universal serial bus interface480. The universal serial bus interface480can be electrically coupled with a computer readable medium (CRM) interface500.

The computer readable medium interface500can be electrically coupled with a solid state non-volatile (e.g., a flash/memristor based ReRAM) storage/memory520to store information. The solid state non-volatile storage/memory520can be partitioned to have both a private password protected storage/memory section (520-A) and a publicly viewable storage/memory section (520-B).

Furthermore, the solid state non-volatile memory520can store legally approved electronic cash (e.g., Bitcoins, digital gold currency and webmoney with traceable serial numbers).

The universal serial bus interface480and computer readable medium interface500can be electrically coupled with a microcontroller540.

A biometric (e.g., a fingerprint/retinal scan) sensor miniature electronic module560(an interface580and a component600) can be electrically coupled with the microcontroller540. The biometric sensor miniature electronic module560can enhance the security of the social wallet electronic module280or the user160by matching the stored biometric scan and an instant biometric scan at a point of presence or at a point of use for both online (Internet purchase) and offline (retail purchase) applications.

An advanced fingerprint sensor module can be fabricated/constructed by combining a silica colloidal crystal with a rubber, wherein the silica colloidal crystal can be dissolved in dilute hydrofluoric (HF) acid, leaving air voids in the rubber and thus creating an elastic photonic crystal. The elastic photonic crystal emits an intrinsic color, displaying three-dimensional (3-D) shapes of ridges, valley and pores of a fingerprint, when a finger is pressed onto the advanced fingerprint sensor. Details on the advanced fingerprint sensor have been described/disclosed in U.S. Non-Provisional patent application Ser. No. 11/952,001, entitled “DYNAMIC INTELLIGENT BIDIRECTIONAL OPTICAL AND WIRELESS ACCESS COMMUNICATION SYSTEM”, filed on Dec. 6, 2007 (now U.S. Pat. No. 8,073,331, issued on Dec. 6, 2011).

A near-field communication miniature electronic module620(an interface640and a component660) can be electrically coupled with the microcontroller540. Near-field communication is proximity range 13.56 MHz wireless (or radio) protocol.

Near-field communication has two key components: an initiator and a target. The initiator actively generates a radio frequency (RF) field that can electrically power a passive target without a battery.

A near-field communication tag contains simple data to perform a task (e.g., paying for the product and/or service and exchanging data between users). The near-field communication tag can securely store data (e.g., a personal identification number, debit/credit card information, loyalty card information, health record, physical access information, logical access information and digital rights access for local digital rights storage). But the near-field communication tag can also be re-writeable and be used as proximity based wireless charger.

A Wibree (a low electrical power, short-range wireless (or radio) protocol) miniature electronic module680(an interface700and a component720) can be electrically coupled with the microcontroller540.

A DASH7 (a low electrical power, -moderate-range wireless (or radio) protocol) miniature electronic module740(an interface760and a component780) can be electrically coupled with the microcontroller540. DASH7's electrical power requirements are about 10% of its next closest competitor (IEEE 802.15.4) and an even smaller fraction of WiFi and Bluetooth. With DASH7 miniature electronic module720, the user160passing by a restaurant at a low velocity (e.g., about 5 mph) could simply click a “get info” button to seek a customer review (or the merchant score) of the restaurant, before the user160decides to eat at the restaurant or not.

A Bluetooth miniature electronic module800(an interface820and a component840) can be electrically coupled with the microcontroller540to transmit and/or receive data.

A WiFi miniature electronic module860(an interface880and a component900) can be electrically coupled with the microcontroller540to transmit and/or receive data.

An ultra wideband miniature electronic module920(an interface940and a component960) can be electrically coupled with the microcontroller540to transmit and/or receive a vast quantity of data (e.g., a movie) in a short period of time.

A 60 GHz millimeter wave miniature electronic module980(an interface1000and a component1020) can be electrically coupled with the microcontroller540to transmit and/or receive a vast quantity of data (e.g., a movie) in a short period of time. The 60 GHz millimeter wave miniature electronic module980can enable applications such as (a) wireless docking and (b) distributed storage.

A software-defined radio1040can be fabricated/constructed by integrating a tunable antenna1060, a carbon nanotube tunable filter1080and an analog to digital converter1100.

The tunable antenna1060can tune in between 2 GHz and 3 GHz by utilizing a carbon nanotube. The tunable antenna1060can merge/integrate many antennas into one single antenna.

The software-defined radio1040and tunable antenna1060can be electrically coupled with the microcontroller540.

Additionally, a sensor (e.g., a wireless sensor-radio frequency identification (RFID))1120can be electrically coupled with the microcontroller540.

Furthermore, a line-of-sight optical transceiver1140(integrating an array of multi-color light source modulators1160, an array of photodiodes1180, two (2) waveguide combiner/decombiner1200and two (2) lenses1220) can be electrically coupled with the microcontroller540. The optical transceiver1140can transmit and/or receive a vast quantity of data (e.g., a movie) in a short period of time.

Additionally, an electrical power provider component (a thick-film/thin-film battery/solar cell/micro fuel-cell/supercapacitor)1240can be electrically coupled with the microcontroller540. It should be noted that the electrical power provider component1240can be enabled for wireless (e.g., near-field communication based) charging.

Furthermore, the microcontroller540can be replaced by a high-performance microprocessor1360.

Furthermore, the sensor1120can be a biosensor, wherein two embodiments of the biosensor are described inFIGS.3B and3Calong with the Table-1 and Table-2:

TABLE 1FIG. 3B LegendDescription1120-ASilicon Nanowire1120-A1Lipid Layer1120-BInsulator (e.g., Silicon Dioxide)1120-CGate (e.g., Silicon Substrate)1120-DSource Metal1120-EDrain Metal1120-FReceptor (e.g., Antibody Or Aptamer)1120-GBiomarker Protein1120-HNanobattery1120-INanotransmitter1120-JNanotube (e.g., Carbon Nanotube)1120-KNegative Electrode1120-LPositive Electrode

TABLE 2FIG. 3C LegendDescription1120-A2Chitosan1120-BInsulator (e.g., Silicon Dioxide)1120-CGate (e.g., Silicon Substrate)1120-DSource Metal1120-EDrain Metal1120-FReceptor (e.g., Antibody Or Aptamer)1120-GBiomarker Protein1120-HNanobattery1120-INanotransmitter1120-JNanotube (e.g., Carbon Nanotube)1120-KNegative Electrode1120-LPositive Electrode

FIG.3Billustrates an application of the sensor1120, as the biosensor, which can be integrated with the social wallet electronic module280. In the sensor1120, a silicon nanowire field effect transistor (FET), a source is identified by S, a drain is identified by D and a gate is identified by G. Furthermore, the silicon nanowire can be coated with a lipid layer and integrated with receptors on the lipid layer. The receptors can chemically bind with a biomarker protein (e.g., a disease biomarker protein)—thus giving rise to electrical signals (due to changes in the electrical properties of the silicon nanowire), further transmitted by a nanotube (e.g., a carbon nanotube) based wireless (or radio) transmitter. The nanotube based wireless (or radio) transmitter can be electrically powered with a nanobattery.

FIG.3Cillustrates a disease detection application of the sensor1120, as the biosensor, which can be integrated with the social wallet electronic module280. In1120, chitosan proton (ionic) field effect transistor (H+FET), a source is identified by S, a drain is identified by D and a gate is identified by G. Furthermore, chitosan can be integrated with receptors. The receptors can chemically bind with a biomarker protein (e.g., a disease biomarker protein)—thus giving rise to electrical signals (due to changes in the electrical properties of chitosan), further transmitted by a nanotube (e.g., a carbon nanotube) based wireless (or radio) transmitter. The nanotube based wireless (or radio) transmitter can be electrically powered with the nanobattery.

Furthermore, the sensor1120, as the biosensor can be integrated with the near-field communication miniature electronic module620on a human body to enable a smart biosensor to transmit vital health data to a near-field communication terminal. Alternatively, at least the sensor1120, as the biosensor can be implanted within a human body by utilizing a biocompatible outer case.

FIG.3Dillustrates a solar cell1240-A as an electrical power provider component. About 2 microns thick meso-porous TiO2thin-film1240-D can be coated with nanocrystals/nanoshells1240-E. The nanocrystals/nanoshells1240-E can cage/encapsulate light-absorbing organic dye molecules (e.g., porphyrins and/or phthalocyanines)1240-F. Furthermore, the nanocrystals/nanoshells1240-E can contain another specific molecule1240-G for energy transfer upon excitation.

The nanocrystals/nanoshells1240-E can also be varied in diameter to have an absorption over wider wavelength range in order for the solar cell1240-A to be more efficient (for light to electricity conversion).

Furthermore, the solar cell1240-A could be made more efficient (for light to electricity conversion) with an addition of an array of nanotubes (e.g., carbon or boron nitride nanotubes)1240-H.

The meso-porous TiO2thin-film1240-D can be sandwiched between two electrodes: indium tin oxide transparent front electrode1240-J and back metal (e.g., aluminum, silver or platinum) electrode1240-C.

Furthermore, the back metal electrode1240-C can be fabricated/constructed with nanocorrugated plasmonic reflectors to trap more residual light inside the solar cell1240-A.

The meso-porous TiO2thin-film1240-D can be immersed within a liquid ionic electrolyte solution1240-I.

FIG.3Eillustrates the solar cell1240-A as the electrical power provider component. Triple junction semiconductor epitaxial layers1240-P can be purchased from Microlink Devices. The critical element of this embodiment is (a) chemically separating (by selectively etching 50 nanometers thick AlAs layer in hydrofluoric acid), (b) lifting (by covering the patterned front device side with a black wax) triple junction semiconductor epitaxial layers1240-P, all other relevant layers (such as GaAs layer1240-M and InGaAlP layer1240-N), p-metallization1240-R and n-metallization1240-S, (c) bonding onto the glass substrate1240-B with an adhesion layer1240-L and (d) finally dissolving the black wax in trichloroethylene (TCE).

FIG.3Fillustrates a cross-section of the solar cell1240-A as the electrical power provider component. The critical element of this embodiment is (a) chemically separating (by selectively etching 50 nanometers thick AlAs layer in hydrofluoric acid), (b) lifting (by covering the patterned front device side with a black wax) three-dimensional quantum dot superlattice of InAs1240-Q, all other relevant layers (such as GaAs layer1240-M and InGaAlP layer1240-N), p-metallization1240-R and n-metallization1240-S, (c) bonding onto the glass substrate1240-B with an adhesion layer1240-L and (d) finally dissolving the black wax in trichloroethylene.

FIG.3G1illustrates a healthcare related application of the social wallet electronic module280: how the social wallet electronic module280can be utilized to obtain healthcare related advice from a healthcare expert system (a virtual doctor) at a cloud server. The social wallet electronic module280can be integrated with the sensor1120as the biosensor or a point-of-care diagnostic device. In step4056, the social wallet electronic module280transmits wireless (or radio) network settings to the cloud based healthcare expert system (the virtual doctor)100A. In step4057, the social wallet electronic module280establishes wireless (or radio) connection with the cloud based healthcare expert system (the virtual doctor)100A. In step4058, the social wallet electronic module280establishes security verification with the cloud based healthcare expert system (the virtual doctor)100A. In step4059, the social wallet electronic module280transfers the user's health related data to the cloud based healthcare expert system (the virtual doctor)100A. In step4060, the social wallet electronic module280receives expert healthcare advice from the cloud based healthcare expert system (the virtual doctor)100A. In step4061, the user160pays using the social wallet electronic module280(integrated with a biosensor) for the expert advice received from the cloud based healthcare expert system (the virtual doctor)100A. Various embodiments of the point-of-care diagnostic device have been described/disclosed in U.S. Non-Provisional patent application Ser. No. 14/999,601 entitled “SYSTEM AND METHOD OF AMBIENT/PERVASIVE USER/HEALTHCARE EXPERIENCE”, filed on Jun. 1, 2016 (which claims benefit of priority to U.S. Provisional Patent Application No. 62/230,249 entitled “SYSTEM AND METHOD OF AMBIENT/PERVASIVE USER/HEALTHCARE EXPERIENCE”, filed on Jun. 1, 2015), U.S. Non-Provisional patent application Ser. No. 14/120,835 entitled “AUGMENTED REALITY PERSONAL ASSISTANT APPARATUS”, filed on Jul. 1, 2014 and U.S. Non-Provisional patent application Ser. No. 13/663,376 entitled “OPTICAL BIOMODULE FOR DETECTION OF DISEASES”, filed on Oct. 29, 2012 (or “OPTICAL BIOMODULE FOR DETECTION OF DISEASES”, U.S. Pat. No. 9,557,271, issued on Jan. 31, 2017).

FIG.3G2is similar to FIG.3G1, except it illustrates a healthcare (as a virtual doctor) related application of the social wallet electronic module, according to another embodiment of the present invention, utilizing one or more machine learning algorithms (including an evolutionary algorithm) represented by “Fazila”, a super system-on-chip, a photonic neural learning processor/quantum computer and a blockchain. The cloud based healthcare expert system is coupled with the social wallet electronic module280(integrated with a biosensor) via a blockchain.

The cloud based healthcare expert system is coupled with “Fazila” (an integrated software module for machine learning). Furthermore, “Fazila” can be coupled with a super system-on-chip and a photonic neural learning processor/quantum computer.

Compared to FIG.3G1, in FIG.3G2, the step4058is replaced by the step4058-A, wherein the social wallet electronic module280verifies a user identification via biometrical identification and/or near-field communication, the step4059is replaced by the step4059-A, wherein the social wallet electronic module280transfers confidential health data to the cloud based healthcare expert system (the virtual doctor)100A via a blockchain, the step4060is replaced by the step4060-A, wherein the social wallet electronic module280receives confidential healthcare advice from the cloud based healthcare expert system (the virtual doctor)100A via a blockchain, the step4061is replaced by the step4061-A, wherein the social wallet electronic module230pays for the confidential healthcare advice via a blockchain. It should be noted that the social wallet electronic module280can be replaced by a mobile internet device300.

Details of “Fazila”, a super system-on-chip and a quantum computer have been described/disclosed (e.g., FIG. 10A of U.S. Non-Provisional patent application Ser. No. 16/602,404) in U.S. Non-Provisional patent application Ser. No. 16/602,404 entitled “SYSTEM AND METHOD OF AMBIENT/PERVASIVE USER/HEALTHCARE EXPERIENCE”, filed on Sep. 28, 2019.

FIG.3H1illustrates a consumer related application of the social wallet electronic module280: how the social wallet electronic module280can be utilized to obtain a movie from the cloud based movie storage system100B. In step4056, the social wallet electronic module280transmits a wireless (or radio) network setting(s) to the cloud based movie storage system100B. In step4057, the social wallet electronic module280establishes a wireless (or radio) connection with the cloud based movie storage system100B. In step4058, the social wallet electronic module280establishes a security verification with the cloud based movie storage system100B. In step4060, the social wallet electronic module280receives (downloads) a movie from the cloud based movie storage system100B. In step4061, the user160pays for the movie received (downloaded) from the cloud based movie storage system100B using the social wallet electronic module280for a specified period of time, after the specified period of time, the received (downloaded) movie can be automatically disabled by a set of instructions (e.g., computer codes).

FIG.3H2is similar to FIG.3H1, except it illustrates a consumer related application (e.g., a movie rental) of the social wallet electronic module, according to another embodiment of the present invention, utilizing one or more machine learning algorithms (including an evolutionary algorithm), a super system-on-chip, a photonic neural learning processor/quantum computer and a blockchain.

Compared to FIG.3H1, in FIG.3H2, the step4058is replaced by the step4058-A, wherein the social wallet electronic module280verifies a user identification via biometrical identification and/or near-field communication, the step4060is replaced by the step4060-A, wherein the social wallet electronic module280receives a movie from the cloud based movie storage system100B via a blockchain, the step4061is replaced by the step4061-A, wherein the social wallet electronic module280pays for the movie via a blockchain. It should be noted that the social wallet electronic module280can be replaced by a mobile internet device300.

Alternatively, a movie storage system can be located at widely distributed (and conveniently located) kiosks, instead of the cloud based movie storage system100B. Furthermore, the rented movie can have coded expiry date, after that the rented movie will not run.

FIG.3Iillustrates a consumer related application of user defined credit scoring application of the social wallet electronic module, according to one embodiment of the present invention, utilizing one or more machine algorithms (including an evolutionary algorithm), a super system-on-chip, a photonic neural learning processor/quantum computer and a blockchain.

Critically inFIG.3I, in step4062-A, wherein the social wallet electronic module280transmits confidential history/log of a user's bill payments to the cloud based credit scoring system100C via a blockchain, in step4063-A, the social wallet electronic module280receives a user's credit score from the cloud based credit scoring system100C.

FIG.3Jillustrates a consumer related application of user defined service (e.g., a self-driving car rental) application of the social wallet electronic module, according to one embodiment of the present invention, utilizing one or more machine learning algorithms (including an evolutionary algorithm), a super system-on-chip, a photonic neural learning processor/quantum computer and a blockchain.

Critically inFIG.3J, in step4064-A, a user receives user specified service (e.g., a self-driving car rental) from a cloud based user service system100D.

FIG.3Killustrates a consumer related application of user defined online/offline shopping application of the social wallet electronic module, according to one embodiment of the present invention, utilizing one or more machine learning algorithms (including an evolutionary algorithm), a super system-on-chip, a photonic neural learning processor/quantum computer, a blockchain and augmented reality. Following FIGS. 9A-9D of U.S. Non-Provisional patent application Ser. No. 16/602,404 entitled “SYSTEM AND METHOD OF AMBIENT/PERVASIVE USER/HEALTHCARE EXPERIENCE”, filed on Sep. 28, 2019, the social wallet electronic module can be replaced by a physical card, wherein the physical card can include a magnetic strip, a wireless communication chip (e.g., a near-field communication chip), a dynamically reconfigured/changed card verification value number. The physical card can also include a biometric sensor.

Critically inFIG.3K, in step4065-A, a user receives user specified product/service from the cloud based online/offline shopping system100E with or without an augmented reality link, in step4065-A, a user finds the user specified product/service in a offline (retail) store.

FIG.4illustrates a block diagram of the object240. The object240has ultra-low electrical power consumption and miniature medium performance microprocessor (e.g., an Ambiq Micro or InAs-on-Insulator based microprocessor or a memristor)1260, which can be electrically coupled with: (a) a sensor (e.g., a wireless sensor-a radio frequency identification)1120, (b) an optional IP/micro IP/light weight IP address1280, (c) a miniature memory/storage (e.g., a memristor)1300, (d) an embedded tiny operating algorithm/executable instructions1320(e.g., a Tiny OS), (e) a miniature low electrical power “object-specific” miniature wireless (or radio) transmitter (e.g., a radio frequency identification and/or a Wibree and/or a Bluetooth and/or a WiFi and/or a near-field communication) with a miniature antenna1340and (f) an “object-specific” electrical power provider component1240-T (e.g., the solar cell1240-A in a miniature form factor).

Furthermore, the object240can have an outer external case. The object240can also be a biological object on or within (e.g., implanted by utilizing the outer external case, which is biocompatible) a human body.

The object240can utilize semiconductor fabrication, micro-electromechanical systems fabrication, plastic electronics fabrication, printed electronics fabrication, multi-chip module fabrication (packaging), three-dimensional fabrication (packaging) and microfluidic fabrication.

The array of objects240scan connect to the node (e.g., the node with an internet connection)260. The node260can map, sense, measure, collect, aggregate, compare information collected from the army of objects240s. The node260can share/communicate information with the social wallet100and/or electronic social wallet electronic module280and/or mobile internet device300.

The objects240sand node260can self-register with a blockchain for integration. For example, when the object240/node260detects something wrong, it can automatically request a smart repair contract. Additionally, the node260can be integrated with an automated agent/bot including a voice/text interface.

Furthermore, the electronic social wallet electronic module280and/or mobile internet device300can proximity contact or physically contact with the object240to communicate for relevant information.

FIG.5Aillustrates a block diagram of the mobile internet device300. It has the high performance microprocessor (e.g., Intel's x86 based Medfield)1360, which can be electrically coupled with (a) the social wallet electronic module280(in this case the social wallet electronic module280does not require the separate microcontroller540or the microprocessor1360, but it shares the high performance microprocessor1360of the mobile internet device), (b) a general data storage electronic module520-C, (c) the IP/micro IP/light weight IP address1280, (d) a lab-on-chip electronic module (a biological diagnostics electronic module)1360, (e) an embedded operating algorithm1380stored in a general data storage electronic module520-C, (f) an internet security algorithm (internet firewall/spyware/user-specified security control and authentication)1400, (g) a one-dimensional/two-dimensional barcode/quick response code reader1420, (h) a miniature wireless (or radio) electronic module (e.g., a radio frequency identification/Bluetooth/WiFi/global positioning system location (GPS) with an antenna(s))1440for an indoor/outdoor location measurement, (i) an electronic compass1460, (j) two (2) cameras (a 180 degree rotating camera is preferred, instead of two cameras—one for video chat and one for photo taking)1480, (k) a video conferencing (integrated with dynamic video compression algorithm) system-on-chip1500, (l) a display component1520, (m) a micro-projector1540, (n) a sketch pad (with a write/erase option) electronic module1560with a stylus1580, (o) a communication wireless (or radio) transceiver electronic module (e.g., WiMax/LTE) with an antenna(s)1600, (p) a personal awareness assistant miniature electronic module1620, (q) a voice-to-text-to-voice conversion algorithm1640and (r) an algorithm1660

Furthermore, the mobile internet device300has the electrical power provider component. (e.g., battery/solar cell/micro fuel-cell/supercapacitor)1240. It should be noted that the electrical power provider component1240can be enabled for wireless (e.g., near-field communication based) charging.

A multi-touch high definition liquid crystal display (integrated with an array of thin-film transistors on indium gallium zinc oxide) can be utilized as the display component1520.

Organic light emitting (red, green and blue) diodes driven by an array of organic thin-film transistors on an organic substrate (e.g., plastic) can also be utilized as the rolled up/foldable/stretchable display component1520. The rolled up/foldable/stretchable display component1520can minimize its size related distinction between a portable computer (e.g., a laptop) and the mobile internet device300.

Additionally, the rolled up/foldable/stretchable display component1520can be constructed from a graphene sheet and/or an organic light-emitting diode connecting/coupling/interacting with a printed organic transistor and a rubbery conductor (e.g., a mixture of a carbon nanotube/gold conductor and a rubbery polymer) with a touch/multi-touch sensor.

Furthermore, the display component1520can enable a dual-view to show entirely two separate scenes simultaneously.

Furthermore, organic light emitting diodes based display component1520may be more transparent to a short wavelength infrared (SWIR) photodetector than a near infrared (NIR) photodetector. Such a short wavelength infrared photodetector (two-dimensional (2-D)) array (e.g., 1280×1024 pixel format) can be fabricated utilizing InGaAs material or quantum dots or germanium (Ge) on silicon (Si) substrate or even GeSn/Ge MQW on silicon substrate. Furthermore, short wavelength infrared photodetector can include a resonant cavity enhanced (RCE) (e.g., utilizing a bottom Bragg reflecting mirror and a top Bragg reflecting mirror.

It should be noted that the short wavelength infrared photodetector (two-dimensional) array can be replaced by a (two-dimensional) array of phototransistors or a (two-dimensional) array of microscaled (e.g., about 0.5 microns to 3 microns diameter etched mesa) phototransistors. Microscaled mesa phototransistors may offer higher detection sensitivity.

Such a short wavelength infrared photodetector (two-dimensional) array can be electrically coupled with one or more electronic circuits (e.g., a read-out integrated circuit—ROIC) via fine pitch indium bump bonding or fine pitch metal-to-metal bonding.

Additionally, the read-out integrated circuit can also be electrically coupled with a Super System on Chip for ultrafast data processing, image processing/recognition, deep learning/meta-learning and self-learning. Unlike traditional central processing units capable of processing serialized instruction streams, neural processing units can be capable of processing machine learning workloads (which may be highly parallelizable with high regularity in the computational patterns of deep neural networks). It should be noted that in some applications, a Super System on Chip may be replaced by a neural processor (e.g., Google's Tensor Processing Unit—TPU).

Organic light emitting diodes based display component1520can be positioned above a short wavelength infrared photodetector (two-dimensional) array/phototransistor (two-dimensional) array/microphototransistor (two-dimensional) array (also a short wavelength infrared photodetector (two-dimensional) array/phototransistor (two-dimensional) array/microphototransistor (two-dimensional) army can include a read-out integrated circuit) for a three-dimensional (3-D) display coupled sensor (e.g., a under-display sensor) on the mobile internet device300(or on a computer).

For nighttime application, a three-dimensional display coupled sensor may require one or more eye-safe lasers (e.g., vertical cavity surface emitting laser (VCSEL) diodes/edge emitting laser diodes) operating in short wavelength infrared range and also compatible with a short wavelength infrared photodetector (two-dimensional) array/phototransistor (two-dimensional) array/microphototransistor (two-dimensional) array. A short wavelength infrared photodetector (two-dimensional) array/phototransistor (two-dimensional) array/microphototransistor (two-dimensional) array may also include one or more single photon avalanche diodes (SPADs). An edge emitting laser diode with higher output power (operating in short wavelength infrared range) may enable longer range and higher reliability of three-dimensional display coupled sensing.

Furthermore, (i) one or more laser diodes and (ii) a short wavelength infrared photodetector (two-dimensional) array/phototransistor (two-dimensional) array/microscaled phototransistor (two-dimensional) array can be integrated/co-placed on a suitable common substrate by heterogeneous fabrication process (e.g., micro-transfer printing (MTP)).

Furthermore, organic light emitting diodes based display component1520may be positioned above a short wavelength infrared photodetector (two-dimensional) array/phototransistor (two-dimensional) array/microphototransistor (two-dimensional) array (also a short wavelength infrared photodetector (two-dimensional) array/phototransistor (two-dimensional) array/microphototransistor (two-dimensional) array can include a read-out integrated circuit and a processor/Super System on Chip) for a three-dimensional (3-D) intelligent/smart display coupled sensor on the mobile internet device300(or on a computer).

The Super System on Chip that includes memristors can be electrically and/or optically controlled. For example, memristors made of a phase transition material (e.g., vanadium dioxide-VO2) can be electrically and/or optically controlled. Alternatively memristors made of a phase change material (e.g., Ge2Sb2Te5(GST)) can be either electrically or optically controlled.

There is a distinction between a phase transition material and a phase change material. For example, in case of a phase transition material, such as vanadium dioxide, there is volatile phase transition from insulating (about band gap 0.7 eV) monoclinic crystalline phase to metallic (i.e., bands gap collapse and delocalized electrons) in a rutile crystalline phase with a corresponding change in symmetry and reduced (by half) unit cell. But in case of a phase change material, such as GST, there is non-volatile phase change from glassy phase to crystalline phase with accompanying change of dielectric function.

A three-dimensional display coupled sensor or a three-dimensional intelligent/smart display coupled sensor may enablebiometric sensing,range sensing.sensing in mixed reality/metaverse on the mobile internet device300(or on a computer).Furthermore it can identify, delineate, classify and render image content (or with avatars it can experience real time eye contact and facial expressions).

Details of various embodiments of a detector array have been described/disclosed in U.S. Non-Provisional patent application Ser. No. 16/602,404 entitled “SUPER SYSTEM ON CHIP”, filed on Sep. 28, 2019.

Details of various embodiments of a Super System on Chip have been described/disclosed in U.S. Non-Provisional patent application Ser. No. 16/602,404 entitled “SUPER SYSTEM ON CHIP”, filed on Sep. 28, 2019 subsequently in U.S. Non-Provisional patent application Ser. No. 17/803,388 entitled “SUPER SYSTEM ON CHIP”, filed on Jun. 15, 2022.

If both the display component1520and electrical power provider component are thinner, then the mobile internet device300would be thinner. A thinner organic battery component can be fabricated/constructed as follows: an organic battery utilizes push-pull organic molecules, wherein after an electron transfer process, two positively charged molecules are formed, which are repelled by each other like magnets. By installing a molecular switch an electron transfer process can proceed in the opposite direction. Thus, forward and backward switching of an electron flow can form a basis of an ultra-thin, light weight and electrical power efficient organic battery. Details on the thinner organic battery have been described/disclosed in U.S. Non-Provisional patent application Ser. No. 11/952,001, entitled “DYNAMIC INTELLIGENT BIDIRECTIONAL OPTICAL AND WIRELESS ACCESS COMMUNICATION SYSTEM”, filed on Dec. 6, 2007 (now U.S. Pat. No. 8,073,331, issued on Dec. 6, 2011).

Furthermore, the algorithm1660includes: (a) a physical search algorithm, (b) an algorithm-as-a-service, (c) an intelligent rendering algorithm (e.g., artificial intelligence, behavior modeling, data interpretation, data mining, fuzzy logic, machine vision, natural language processing, neural network, pattern recognition and reasoning modeling) and (d) a self-learning (including relearning) algorithm. It should be noted that the self-learning (including relearning) algorithm can include a self-learning artificial intelligence algorithm and/or a self-learning neural network algorithm

In the context of the mobile internet device300, data can be compared with respect to a set of parameters to learn or relearn continuously by analyzing patterns of data, where patterns of data can consist/utilize/couple with the algorithm1660.

The algorithm1660of the mobile internet device300includes the intelligent rendering algorithm (e.g., artificial intelligence, behavior modeling, data interpretation, data mining, fuzzy logic, machine vision, natural language processing, neural network, pattern recognition and reasoning modeling). Additionally, the mobile internet device300can be integrated with an automated agent/bot (including a voice/text interface), enhanced by the algorithm1660.

In the context of the social wallet100, data can be compared with respect to a set of parameters to learn or relearn continuously by analyzing patterns of data, where patterns of data can consist/utilize/couple with the fuzzy logic algorithm360, the intelligence rendering algorithm400and the self-learning (including relearning) algorithm420. It should be noted that the self-learning (including relearning) algorithm420can include a self-learning artificial intelligence algorithm and/or a self-learning neural network algorithm

Furthermore, this continually learned analysis along with the predictive algorithm380can enable the social wallet100to identify a set of users with particular parameters for a targeted advertisement.

The antenna for the communication wireless (or radio) transceiver1600of the mobile internet device300can be fabricated/constructed from metamaterial. Metamaterial is a material of designer crystal structure combining two materials (e.g., lead selenide and iron oxide).

Furthermore, the antenna can be integrated with/onto an outer external case of the mobile internet device300.

The outer external case of the mobile internet device300can be fabricated/constructed from a nano-engineered aluminum/magnesium alloy and/or a liquid metal alloy and/or glass.

The outer external case of the mobile internet device300can also be fabricated/constructed from carbon fibers embedded with plastic. Carbon fibers can be inserted into an injection mold of a plastic film and bonded to the molten injection mold of the plastic film, thereby forming a composite material of the carbon fibers and plastic film.

FIG.5Billustrates a cross-section of the display component1520of the mobile internet device300, which utilizes highly efficient quantum dot light emitting diodes1520-A (red, green and blue) incident at an angle with respect to the lower glass substrate1520-B. The lower glass substrate1520-B has built-in corrugations and waveguides to enable reflection of an incident light from the quantum dot light emitting diodes.

Table-3 below describes subcomponents required to fabricate/construct the display component1520. The critical subcomponents are micro-electromechanical systems micro shutters, which are monolithically integrated with an array of thin-film transistors (TFTs) (e.g., fabricated/constructed on zinc oxide or zinc-indium-tin oxide or graphene oxide).

TABLE 3FIG. 5B LegendDescription1520-AQuantum Dot Light Emitting Diodes(Red, Green & Blue)1520-BLower Glass Substrate With Built-InCorrugations & Waveguides1520-CArray of Transparent Lower Pixel Electrodes1520-DArray of Thin-Film Transistors1520-EScanning Transparent Electrodes1520-FSignal Transparent Electrodes1520-GMicro-Electromechanical Systems Micro ShuttersMonolithically Integrated With A Thin-FilmTransistor1520-HMonolithic Integration of 1520-D, 1520-E,1520-F & 1520-G1520-ITransparent Upper Common Electrode1520-JUpper Glass Substrate

This can enable an efficient high brightness display component1520at lower electrical power consumption, eliminating two (2) polarizer filter films, color filter and liquid crystal. This is substantially compatible with standard display component manufacturing methods/processes.

Furthermore, a quantum dot white light emitting diode (with a specific thin-film color filter (to transmit only optically filtered red or green or blue light), preferably located below the upper glass substrate) can be used instead of a quantum dot red light emitting diode, a quantum dot green light emitting diode and a quantum dot blue light emitting diode.

The thin-film transistor1520-D located at each pixel can control an image at each pixel of the display component1520. However, the thin-film transistor1520-D can also have a light sensing circuitry to sense the light reaching the pixel of the display component1520from its surroundings—thus enabling a possibility of new user experience with the display component1520.

FIG.5Cillustrates1520-H: a micro-eloctromechanical systems micro shutter1520-G, which can be monolithically integrated with an array of thin-film transistors1520-D (e.g., fabricated/constructed on zinc oxide or zinc-indium-tin oxide or graphene oxide).

The Table-4 below describes subcomponents required to fabricate/construct the micro-electromechanical systems micro shutter1520-G, which can be monolithically integrated with an array of thin-film transistors1520-D (e.g., fabricated/constructed on zinc oxide or zinc-indium-tin oxide or graphene oxide).

TABLE 4FIG. 5C LegendDescription1520-KThin-Film1520-LGate Dielectric1520-GMicro Shutter1520-NSource Electrode Or Drain Electrode1520-MActuation Electrode1520-0Release Layer

FIG.5Dillustrates a cross-section of another display component1520-T integrated with the solar cell1240-A.

FIG.5Eillustrates a cross-section of another enabling configuration of the display component1520of the mobile internet device300. Along with an array of thin-film transistors1520-D, the critical element of this configuration is lifted semiconductor quantum-wells layers1520-P on a glass substrate (e.g. the glass substrate1240-B). Furthermore, the semiconductor quantum-wells layers1520-P have both p-metal and n-metal contacts.

The semiconductor quantum-well layers1520-P can be electrically excited by current from a battery. The released energy can be non-radiatively transferred to nanocrystal quantum dots (of various diameters/sizes)1520-Q to produce red, green and blue light from an adjacent layer of nanocrystal quantum dots1520-Q to enable an efficient color display component1520.

FIG.5Fillustrates a cross-section of another enabling configuration of the display component1520of the mobile internet device300. Along with an array of thin-film transistors1520-D the critical element of this configuration is epitaxially lifted semiconductor quantum-well layers1520-P on a glass substrate (e.g., the glass substrate1240-B). Furthermore, the semiconductor quantum-well layers1520-P have both p-metal and n-metal contacts.

The semiconductor quantum-well layers1520-P can be electrically excited by current from a battery. The released energy can be non-radiatively transferred to uniformly sized nanocrystal quantum dots1520-R to produce white light emission from an adjacent layer of uniformly sized nanocrystal quantum dots1520-R. The white light can be filtered by an array of thin-film color filters1520-S to enable an efficient color display component1520. Details of a quantum dot display have been described/disclosed in U.S. Non-Provisional patent application Ser. No. 12/931,384 entitled “DYNAMIC INTELLIGENT BIDIRECTIONAL OPTICAL ACCESS COMMUNICATION SYSTEM WITH OBJECT/INTELLIGENT APPLIANCE-TO-OBJECT/INTELLIGENT APPLIANCE INTERACTION”, filed on Jan. 31, 2011 (now U.S. Pat. No. 8,548,334, issued on Oct. 1, 2013) (which claims benefit of priority to U.S. Provisional application Ser. No. 61/404,504 entitled “DYNAMIC INTELLIGENT BIDIRECTIONAL OPTICAL ACCESS COMMUNICATION SYSTEM WITH OBJECT/INTELLIGENT APPLIANCE-TO-OBJECT/INTELLIGENT APPLIANCE INTERACTION”, filed on Oct. 5, 2010). Details of various embodiments of the display/holographic display as the display component1520of the mobile wearable internet device300have been described/disclosed in U.S. Non-Provisional patent application Ser. No. 14/999,601 entitled “SYSTEM AND METHOD OF AMBIENT/PERVASIVE USER/HEALTHCARE EXPERIENCE”, filed on Jun. 1, 2016 (which claims benefit of priority to U.S. Provisional Patent Application No. 62/230,249 entitled “SYSTEM AND METHOD OF AMBIENT/PERVASIVE USER/HEALTHCARE EXPERIENCE”, filed on Jun. 1, 2015).

FIG.6illustrates a block diagram of the sketch pad (with write/erase options) electronic module1560with the stylus1580. The sketch pad electronic module1560is a multilayer device, having a transparent (e.g., indium tin oxide or graphene) input matrix1680, below the transparent input matrix1680, there is the display component (e.g., a liquid crystal or graphene based display component)1520and below which there is an electronic (scan, drive and display memory) circuitry1700.1560-A is an integrated electronic device, excluding the stylus1580.

The stylus1580can be formed in the shape of a pencil from silicon rubber impregnated with metal particles.

As the stylus1580writes over the transparent input matrix1680, it can capacitively couple with the transparent input matrix1680. Thus, if there is a change in the capacitance, the change in the capacitance can be sensed by the electronic circuitry1700. The electronic circuitry1700can be electrically coupled with a switch1720. Utilizing the switch1720, the sketch pad electronic module1560can be operated in both write and erase modes.

FIG.7illustrates a block diagram of the sketch pad electronic module1560, where the electrical coupling between the transparent input matrix1680, display component1520, electronic circuitry1700and switch1720are described. Furthermore, a hand-writing recognition algorithm and/or a pattern recognition algorithm1740can enhance the performance of the sketch pad electronic module1560.

FIG.8Aillustrates a block diagram of the personal awareness assistant miniature electronic module1620, which integrates: the storage/memory520(however, the storage/memory520can also be replaced by the general storage electronic module520-C), the sensor1120, the medium performance microprocessor1260, the camera1480, the voice-to-text-to-voice conversion algorithm1640, two (2) microphones1760, a scrolling audio recording buffer1780and a voice recognition algorithm1800.

The personal awareness assistant miniature electronic module1620can always be on. It can passively listen to what the user160says and can respond to a particular context and situation. For example: the user160can hear about a product and the user160can create a reminder by speaking to the personal awareness assistant miniature electronic module1620. The user160can transmit that information from the personal awareness assistant miniature electronic module1620to the social wallet100via the electronic social wallet electronic module280and/or mobile internet device300for further processing and/or fulfillment. After processing the information from the personal awareness assistant miniature electronic module1620, the social wallet100can then deliver a real time location based coupon(s) to the mobile internet device300, by measuring the user's160location information by utilizing an indoor/outdoor location measurement miniature electronic module1440of the mobile internet device300.

Optionally the personal awareness assistant miniature electronic module1620can be a standalone miniature electronic module (but it can be plugged or integrated with the social wallet electronic module280/mobile internet device300).

For example, when the user160is introduced to someone, the personal awareness assistant miniature electronic module1620can automatically recognize and may take a low-resolution photo. Once, the mobile internet device300collects information, it can automatically categorize the information into a pre-designated database with audio, digital image, time/date stamp and global positioning system location. Because the data is stored contextually, the information retrieval can be straightforward. In response to a simple voice command inquiry, such as “whom did I meet on Apr. 15, 2009 at 12 PM” ? the personal awareness assistant miniature electronic module1620can bring up the appropriate information about that specific person. Thus, the mobile internet appliance is context-aware.

Furthermore, the voice recognition algorithm1800can enhance the capability of the personal awareness assistant miniature electronic module1620.

Additionally, a face recognition algorithm can enhance the capability of the personal awareness assistant miniature electronic module1620.

FIG.8Billustrates an application of the personal awareness assistant miniature electronic module1620of the mobile internet device300. In step4062, the user finds a product (e.g., on the radio news). In step4063, the personal awareness assistant miniature electronic module1620records that product information with the user's consent. In step4064, the personal awareness assistant miniature electronic module1620transmits the product information to the social wallet100. In step4065, the social wallet100acknowledges the received (product) information from the personal awareness assistant miniature electronic module1620. In step4066, the social wallet100processes the received (product) information from the personal awareness assistant miniature electronic module1620. In step4067, the social wallet100determines the location of the mobile internet device300in real time. In step4068, the social wallet100determines the local stores, where the product can be found. In step4069, the social wallet100directs (turn by turn) the mobile internet device300in real time regarding the location of a specific or closest store, where the product can be found. In step4070, the user160pays for the product using the mobile internet device300(the mobile internet device300can be integrated with the social wallet electronic module230). Furthermore, the social wallet electronic module230is integrated with the near-field communication miniature electronic module620.

As the social wallet100can learn or relearn the user's preferences, the unified algorithm320can render intelligence based on the user's preferences, by utilizing the intelligence rendering algorithm400and the self-learning (including relearning) algorithm420.

Similarly, the mobile internet device300can also learn or relearn the user's preferences, by utilizing the algorithm1660. The algorithm1660includes: (a) a physical search algorithm, (b) an algorithm-as-a-service, (c) an intelligent rendering algorithm (e.g., artificial intelligence, behavior modeling, data interpretation, data mining, fuzzy logic, machine vision, natural language processing, neural network, pattern recognition and reasoning modeling) and (d) a self-learning (including relearning) algorithm. It should be noted that the self-learning (including relearning) algorithm can include a self-learning artificial intelligence algorithm and/or a self-learning neural network algorithm.

The personal awareness assistant miniature electronic module1620is context-aware. Thus, the mobile internet device300is also context-aware.

FIG.9illustrates a block diagram of a first system-on-chip1820-A, integrating a microprocessor1360, a graphics processor unit (GPU)1360-A and an internet security algorithm1400.

FIG.10illustrates a block diagram configuration of a nano-transistor1840-A. A lower nanowire array of a switchable active material (e.g., silicon or germanium)1840-B sandwiched between contacts (e.g., nickel silicide for silicon or nickel germanide for germanium)1840-C can be fabricated/constructed. An upper array of gate metal1840-D enclosed within an insulating shell1840-E can be fabricated/constructed. Voltage applied via the gate metal1840-D can switch the active material1840-B from an off state to an on state.

FIG.11illustrates a block diagram configuration of a second system-on-chip1820-B, which integrates a microprocessor1360-B, (where the microprocessor1360-B is based on nano-transistors1840-A), the graphics processor unit1360-A and the internet security algorithm1400.

Molybdenite (MoS2) is a two-dimensional crystal with a natural bandgap. It is suitable for production of digital integrated circuits. A reduction in bandgap and/or increase in mobility of molybdenite can be achieved by an addition of lithium (Li) ions.

Graphene is also a two-dimensional crystal with a higher carrier mobility, as well as lower noise. It has the ideal properties to be an excellent component of integrated circuits. Graphene epitaxially grown on silicon carbide (SiC) may be suitable for production of integrated circuits.

A graphene variant called graphene has hydrogen atoms attached to the carbon lattice in insulating layers.

Graphyne is a one-atom-thick sheet of carbon that resembles graphene, except in its two-dimensional framework of atomic bonds, which contains triple bonds in addition to double bonds. Graphyne has a graphene-like electronic structure resulting in effectively massless electrons due to Dirac Cones. All electrons are travelling at roughly the same speed (about 0.3% of the speed of light). This uniformity leads to conductivity greater than copper. Graphyne has a capability of self-modulating its electronic properties, which means that it could be used as a semiconductor practically as-is, without requiring any non-carbon dopant atoms to be added as a source of electrons, as non-carbon dopants may be required for graphene. Furthermore, graphyne crystal structure allows electrons to flow in just one direction.

A first lower parallel array of nanoscaled metal (platinum) wires can be fabricated/constructed onto a substrate. A titanium oxide-titanium dioxide thin film can be deposited on the first lower parallel array of nanoscaled metal wires. A second upper parallel array of nanoscaled metal (platinum) wires can be fabricated/constructed on top of the titanium oxide-titanium dioxide thin film. The second upper parallel array is typically fabricated/constructed perpendicular to the first lower parallel array.

A memristor of a titanium oxide-titanium dioxide oxide junction, can be formed when the first lower parallel array of nanoscaled metal (platinum) wires cross the second upper parallel array of nanoscaled metal (platinum) wires. A memristor is less than 50 microns×50 microns in size. A memristor is a two-terminal nanoscaled non-linear passive switching element, whose resistance changes depending on the amount, direction and duration of voltage applied on it. But whatever its past state or resistance was, it freezes at that state, until another voltage is applied to change it. It has a variable resistance and can retain the resistance even when the electrical power is switched off. It is similar to a transistor, used to store data in a flash memory. Since a memristor is a two-terminal microscaled/nanoscaled passive switching element, it can be built on top of transistors to electrically power it up.

Phase-change memory (e.g., germanium-antimony-tellurium) has been used in optical information technologies (e.g., a DVD) and non-volatile memory applications. Furthermore, a phase-change memory material based switching element can be used instead of a memristor. The phase-change memory material based switching element exploits a unique switching behavior of a phase-change material between amorphous (high resistivity) and crystalline (low resistivity) material states with the application of electrical pulses by titanium nitride top electrode and titanium nitride-tungsten bottom electrode to generate the required joule heating for the phase transformation.

Furthermore, a dense local network of switching elements1840s(e.g., based on memristors and/or phase-change memory material based switching elements) can be monolithically integrated with transistors fabricated/constructed on a semiconductor (e.g., silicon or germanium or silicon-germanium) and/or nano-transistors fabricated/constructed on a semiconductor (e.g., silicon or germanium or silicon-germanium) and/or transistors fabricated/constructed on two-dimensional crystal.

FIG.12illustrates the switching element1840based on the memristor and/or phase-change memory material.

Thus, transistors (fabricated/constructed on a semiconductor and/or two-dimensional crystal) with integrated switching elements1840can be utilized to fabricate/construct a reconfigurable (and with lower electrical power consumption) advanced microprocessor1360-C.

FIG.13illustrates a block diagram configuration of a third system-on-chip1820-C, which integrates an advanced microprocessor1360-C, the graphics processor unit1360-A and the internet security algorithm1400.

In the human brain, neurons are connected to each other through programmable junctions called synapses. The synaptic weight modulates how signals are transmitted between neurons and can in turn be precisely adjusted by an ionic flow through the synapse.

The switching element1840is a non-linear resistive device with an inherent memory and similar to a synapse. It is a two-terminal device whose conductance can be modulated by an external stimulus with the ability to store (memorize) the new information. The switching element1840can bring data close to computation without a lot of electrical power consumption, as a biological neural system does.

FIG.14illustrates an embodiment of a neural network microprocessor1360-D.1360-D integrates the switching element1840based synapses, complementary metal-oxide semiconductor (CMOS) pro-neurons1860(fabricated/constructed on a semiconductor and/or two-dimensional crystal) and complementary metal-oxide semiconductor post-neurons1880(fabricated/constructed on a semiconductor and/or two-dimensional crystal).

FIG.15illustrates a block diagram configuration of a fourth system-on-chip1820-D, which integrates an advanced microprocessor (based on a neural network)1360-D, the graphics processor unit1360-A and the internet security algorithm1400.

FIG.16illustrates another embodiment of an advanced microprocessor1360-E (based on a neural network and nano-transistors1840-A).1360-E integrates the switching element1840based synapses, complementary metal-oxide semiconductor pro-neurons1860(fabricated/constructed on a semiconductor and/or two-dimensional crystal), complementary metal-oxide semiconductor post-neurons1880(fabricated/constructed on a semiconductor and/or two-dimensional crystal) and nano-transistors1840-A.

Alternatively, another embodiment of an advanced microprocessor1360-E (based on a neural network and nano-transistors1840-A).1360-E integrates the switching element1840based synapses, complementary metal-oxide semiconductor pro-neurons1860(fabricated/constructed on an electrically induced (e.g., voltage or current) phase change material (e.g., germanium-antimony-tellurium (GST) or Ag4In3Sb67Te26(AIST))), complementary metal-oxide semiconductor post-neurons1880(fabricated/constructed on a semiconductor and/or two-dimensional crystal) and nano-transistors1840-A.

Alternatively, another embodiment of an advanced microprocessor1360-E (based on a neural network and nano-transistors1840-A).1360-E integrates the switching element1840based synapses, complementary metal-oxide semiconductor pro-neurons1860(fabricated/constructed on an electrically induced (e.g., voltage or current) phase transition material (e.g., vanadium dioxide (VO2)), complementary metal-oxide semiconductor post-neurons1880(fabricated/constructed on a semiconductor and/or two-dimensional crystal) and nano-transistors1840-A.

Alternatively, another embodiment of an advanced microprocessor1360-E (based on a neural network and nano-transistors1840-A).1360-E integrates the switching element1840based synapses, complementary metal-oxide semiconductor pro-neurons1860(fabricated/constructed on an optically induced phase transition material (e.g., vanadium dioxide (VO2)), complementary metal-oxide semiconductor post-neurons1880(fabricated/constructed on a semiconductor and/or two-dimensional crystal) and nano-transistors1840-A. It should be noted that optically induced phase transition material may enable a faster switching memristor (hence, a photonic neural learning processor).

Details of a photonic neural learning processor have been described/disclosed in U.S. Non-Provisional patent application Ser. No. 16/602,404 entitled “SYSTEM AND METHOD OF AMBIENT/PERVASIVE USER/HEALTHCARE EXPERIENCE”, filed on Sep. 28, 2019 and its related priority patent applications.

Generally, a phase transition material is a solid material, wherein its lattice structure can change from a particular form to another form, still remaining crystal-graphically solid.

Generally, a phase change material is a material, wherein its phase can change from a solid to liquid, or its phase can change from an amorphous to crystalline, or crystalline to amorphous.

FIG.17illustrates a block diagram configuration of a fifth system-on-chip1820-E, which integrates an advanced microprocessor (based on a neural network and nano-transistors1840-A)1360-E, the graphics processor unit1360-A and the internet security algorithm1400.

A quantum dot memory (e.g., an array of silicon/silicon-germanium quantum dots embedded in epitaxial rare-earth oxide gadolinium oxide (Gd2O3) grown on a silicon substrate of (111) crystal orientation) can be fabricated/constructed with the system-on-chip1820-A/B/C/D/E.

Additionally, a cross-point memory can be fabricated/constructed in multiple layers to form three-dimensionally. The three-dimensional cross-point memory can be fabricated/constructed directly on top of the system-on-chip1820-A/B/C/D/E. Furthermore, the optical interconnect (optical layers) can also be integrated with the system-on-chip1820-A/B/C/D/E. Details on memristors and an optical interconnect have been described/disclosed in U.S. Non-Provisional patent application Ser. No. 14/999,601 entitled “SYSTEM AND METHOD OF AMBIENT/PERVASIVE USER/HEALTHCARE EXPERIENCE”, filed on Jun. 1, 2016 (which claims benefit of priority to U.S. Provisional Patent Application No. 62/230,249 entitled “SYSTEM AND METHOD OF AMBIENT/PERVASIVE USER/HEALTHCARE EXPERIENCE”, filed on Jun. 1, 2015).

The system-on-chips1820-A/B/C/D/Es, optically interconnected can enable the learning (relearning) computer to store and process massive datasets. Furthermore, the system-on-chips1820-A/B/C/D/Es, optically interconnected and a neural network based algorithm(s) can enable supervised, unsupervised and semi-supervised learning. The advanced microprocessors1360-D and1360-E can have Cog Ex machines/Machine OS, as an operating algorithm/system.

FIG.18(A, B and C) illustrates a block diagram of process flow for integrating two (2) two-dimensional crystals on an insulator on a semiconductor substrate (e.g., silicon or germanium or silicon-germanium). Graphene/graphane/graphyne is grown on a substrate X (e.g., graphene can be epitaxially grown on silicon carbide substrate).

Graphene/graphane/graphyne can be patterned with a photoresist and reactive ion beam (RIE) etching. Graphene/graphane/graphyne can be bonded and detached by poly(dimethylsiloxane) (PDMS) onto an insulator on a semiconductor substrate. Thus, the above semiconductor fabrication process/method enables integration of one or two two-dimensional crystals on an insulator on a semiconductor substrate for further circuit fabrication.

For efficient thermal management of the system-on-chip1820-A/B/C/D/E for the mobile internet device300, thermal resistance must be minimized at all material interfaces and materials with closely matching thermal expansion coefficients must be used.

FIG.19illustrates that the circuit side of the system-on-chip1820-A/B/C/D/E can be flip-attached or flip-bonded on an array of thermoelectric films (both n-type and p-type)1920swith a built-in nano-structured surface1900for active cooling.

About ten times (10×) heat transfer can be realized by creating a nano-structured surface (e.g., zinc oxide/graphene nano-structured surface)1900on the thermoelectric film1920. However, significant thermoelectric efficiency can be gained by fabricating a quantum wire/quantum dot based thermoelectric film1920, transitioning from a two-dimensional superlattice.

Furthermore, the thermoelectric film can be attached or bonded on a thermal pillar (e.g., copper material)1940. The thermal pillar1940is about 250 microns in diameter and 50 microns in height. The thermal pillar (e.g., copper material)1940can be attached or bonded on a thermal via1960on a printed circuit board1980with a cooling module2000.

FIG.20Aillustrates the cooling module2000, which can be attached or bonded with the printed circuit board1980to disperse the heat from the system-on-chip1820-A/B/C/D/E. The cooling module2000consists of an array of mini cooling modules2000-As.

FIG.20Billustrates the mini cooling module2000-A. The mini cooling module2000-A has an array of negative voltage biased tips (e.g., tips fabricated/constructed from boron nanotube/carbon nanotube/amorphous diamond/tungsten)2020s, which is placed just below a hole (e.g., about 100 microns in diameter)2040of positive voltage biased surface (e.g., tungsten/two-dimensional crystal material (e.g., graphene))2060. Electrons emitted from the negative voltage biased array of tips2020scan escape through the hole2040and ionize the gas molecules within the boundaries of a heat sink (e.g., the heat sink can be fabricated/constructed from materials such as aluminum/silicon/copper/carbon nanotube-copper composite/two-dimensional crystal material (e.g., graphene)/diamond)2080. By switching the voltage polarity of the heat sink2080, a moving ionized gas cloud can disperse the heat from the printed circuit board1980.

However, it is desirable that an array of tips2020semits electrons at a much lower voltage (e.g., 10 volts).

FIG.20Cillustrates an array of nano-sized tungsten tips2020s, which can be fabricated/constructed on tungsten substrate2040-A. The tungsten tips2020scan be surrounded by an insulator2040-B. The nano-sized tungsten tip2020can be decorated with a monolayer of material2020-A (e.g., diamond deposited by low temperature electron cyclotron resonance-chemical vapor deposition (ECR-CVD) or gold deposited by RF magnetron sputtering) to enable electrons to emit at a much lower voltage (e.g., at 10 volts) through the hole2040, where the hole2040can be fabricated/constructed from a tungsten material.

To achieve faster connectivity between the system-on-chip1820-A/B/C/D/E, an optical interconnection is preferable to an electrical interconnection.

FIG.21Aillustrates a block diagram of an interconnection between the system-on-chip1820-A/B/C/D/E (via optics) on the printed circuit board1980.

The Table-5 below describes subcomponents required to fabricate/construct the interconnection between the system-on-chip1820-A/B/C/D/E (via optics) on the printed circuit board1980,

TABLE 5FIG. 21A LegendDescription1820-A/B/C/D/ESystem-On-Chip2100Complementary Metal-Oxide Semiconductor Serializer2120Complementary Metal-Oxide Semiconductor Driver2140Directly Modulated Vertical Cavity Laser2140-AVertical Cavity Laser Integrated With Electro-OpticalModulator2160Two-Dimensional Photonic Crystal WavelengthDivision Multiplexer On Silicon-On-Insulator (SOI)2180Silicon-On-Insulator Waveguide2200Reconfigurable Optical Switch OnSilicon-On-Insulator2220Silicon-On-Insulator Two-Dimensional PhotonicCrystal Wavelength Division Demultiplexer2240Photodetector2260Complementary Metal-Oxide Semiconductor Amplifier2280Complementary Metal-Oxide SemiconductorDeserializer1820-A/B/C/D/ESystem-On-Chip

Electrical outputs from the system-on-chip (e.g.,1820-A/B/C/D/E) are serialized by a complementary metal-oxide semiconductor serializer2100. The outputs of a complementary metal-oxide semiconductor serializer2100can be utilized as inputs to an array of complementary metal-oxide semiconductor drivers2120s. Correspondingly, the array of complementary metal-oxide semiconductor drivers2120scan activate an array of directly modulated (in intensity) vertical cavity surface emitting lasers2140sor an array of vertical cavity surface emitting lasers, which are monolithically integrated with electro-optic modulators2140-As.

The modulated wavelengths of the directly modulated vertical cavity surface emitting lasers2140sor vertical cavity surface emitting lasers with monolithically integrated with electro-optic modulator2140-As can be combined on wavelengths (or colors) by a silicon-on-insulator two-dimensional photonic crystal wavelength division multiplexer2160.

The wavelengths can be propagated by a silicon-on-insulator waveguide2180and if necessary, can be reconfigured by a reconfigurable optical switch2200on silicon-on-insulator.

The outputs of the silicon-on-insulator waveguide2180or reconfigurable optical switch2200on silicon-on-insulator can be decombined on wavelengths by a silicon-on-insulator two-dimensional photonic crystal wavelength division demultiplexer2220.

Furthermore, the wavelengths outputs (of the silicon-on-insulator two-dimensional photonic crystal wavelength division demultiplexer2220) can be received by an array of photodetectors (e.g., P-i-N photodetectors)2240s, an array of complementary metal-oxide semiconductor amplifiers2260s, then as electrical inputs to a complementary metal-oxide semiconductor deserializer2280and finally as electrical inputs to another system-on-chip (e.g.,1820-A/B/C/D/E).

FIG.21Billustrates details of the silicon-on-insulator waveguide2180, silicon-on-insulator vertical coupler gratings2300and directly modulated vertical cavity surface emitting laser2140or the vertical cavity surface emitting laser with monolithically integrated electro-optic modulator2140-A.

FIG.21Cillustrates details of the silicon-on-insulator waveguide2180, silicon-on-insulator vertical coupler gratings2300and photodiode2240. The shape of the silicon-on-insulator waveguide2180(fabricated/constructed on an oxide buffer layer2320on the silicon substrate2340) can be adiabatically tapered at proximity of the silicon-on-insulator vertical coupler gratings2300. The silicon-on-insulator vertical coupler gratings2300can be shaped linear or curved.

Furthermore, the silicon-on-insulator two-dimensional photonic crystal wavelength division multiplexer2160, silicon-on-insulator waveguide2180, reconfigurable optical switch2200on silicon-on-insulator and silicon-on-insulator two-dimensional photonic crystal wavelength division demultiplexer2220can be embedded within an etched area of polymer layers of the printed circuit board1980. An optical mode match between the silicon-on-insulator waveguide2180and a polymer waveguide (by utilizing a polymer layer of the printed circuit board1980) can be fabricated/constructed. Also, the etched area can be buried within the printed circuit board1980. Alternatively, a polymer (e.g., polyimide) waveguide of the printed circuit board1980can be utilized instead of the silicon-on-insulator waveguide2180.

FIG.21Dillustrates a cross section of2140-A: a vertical cavity surface emitting laser, which can be monolithically integrated with an electro-optic modulator. Similarly, a micro-electromechanical systems tunable vertical cavity surface emitting laser (preferably a quantum dot vertical cavity surface emitting laser) can also be monolithically integrated with an electro-optic modulator.

In summary, the mobile internet appliance300can be coupled by a wireless network or a sensor network,wherein the mobile internet appliance300includes:(a) a system-on-chip (SoC),wherein the system-on-chip includes a microprocessor and/or a graphic processor,(b) a foldable display,(c) a radio transceiver or a sensor module,wherein the radio transceiver or the sensor module includes one or more first electronic components,(d) a voice processing module or a voice processing algorithm;wherein the voice processing module includes one or more second electronic components,wherein the voice processing algorithm includes a first set of instructions to process a voice command,wherein the voice processing algorithm is stored in a first non-transitory storage media,wherein the mobile internet appliance300is further coupled with or further includes:(e) a natural language algorithm, andwherein the natural language algorithm includes a second set of instructions to understand the voice command in a natural spoken language of a user,wherein the natural language algorithm is stored in a second non-transitory storage media,(f) a learning algorithm or an intelligence algorithm,wherein the learning algorithm or the intelligence algorithm is based on or includes an artificial intelligence algorithm,wherein the learning algorithm or the intelligence algorithm includes a third set of instructions to provide learning or intelligence in response to an interest or a preference of the user,wherein the learning algorithm or the intelligence algorithm is stored in the second non-transitory storage media,wherein the first non-transitory storage media and the second non-transitory storage media are same or different,wherein the foldable display in (b), the radio transceiver or the sensor module in (c), the voice processing module or the voice processing algorithm in (d), the natural language algorithm in (e) and the learning algorithm or the intelligence algorithm in (f) are coupled with the system-on-chip in (a).

In summary, alternatively, the mobile internet appliance300can be coupled by a wireless network or a sensor network,wherein the mobile internet appliance300includes:(a) a system-on-chip (SoC),wherein the system-on-chip includes a microprocessor and/or a graphic processor,(b) a display including a solar cell (as illustrated inFIG.5D),(c) a radio transceiver or a sensor module,wherein the radio transceiver or the sensor module includes one or more first electronic components, (d) a voice processing module or a voice processing algorithm;wherein the voice processing module includes one or more second electronic components,wherein the voice processing algorithm includes a first set of instructions to process a voice command,wherein the voice processing algorithm is stored in a first non-transitory storage media, wherein the mobile internet appliance300is further coupled with or further includes:(e) a natural language algorithm, andwherein the natural language algorithm includes a second set of instructions to understand the voice command in a natural spoken language of a user,wherein the natural language algorithm is stored in a second non-transitory storage media,(f) a learning algorithm or an intelligence algorithm,wherein the learning algorithm or the intelligence algorithm is based on or includes an artificial intelligence algorithm,wherein the learning algorithm or the intelligence algorithm includes a third set of instructions to provide learning or intelligence in response to an interest or a preference of the user,wherein the learning algorithm or the intelligence algorithm is stored in the second non-transitory storage media,wherein the first non-transitory storage media and the second non-transitory storage media are same or different,wherein the foldable display in (b) the radio transceiver or the sensor module in (c), the voice processing module or the voice processing algorithm in (d), the natural language algorithm in (e) and the learning algorithm or the intelligence algorithm in (f) are coupled with the system-on-chip in (a).

Furthermore, the mobile internet appliance300can be coupled by or includes a neural processor or a photonic learning neural processor.

Details of a photonic neural learning processor have been described/disclosed in U.S. Non-Provisional patent application Ser. No. 16/602,404 entitled “SYSTEM AND METHOD OF AMBIENT/PERVASIVE USER/HEALTHCARE EXPERIENCE”, filed on Sep. 28, 2019 and its related priority patent applications.

Details of a mobile internet appliance300have been described/disclosed in U.S. Non-Provisional patent application Ser. No. 11/952,001, entitled “Dynamic Intelligent Bidirectional Optical and Wireless Access Communication System, filed on Dec. 6, 2007, (which resulted in a U.S. Pat. No. 8,073,331, issued on Dec. 6, 2011), which claims the benefit of priority toU.S. Provisional patent application Ser. No. 60/970,487 entitled “Intelligent Internet Device”, filed on Sep. 6, 2007,U.S. Provisional patent application Ser. No. 60/883,727 entitled “Wavelength Shifted Dynamic Bidirectional System”, filed on Jan. 5, 2007,U.S. Provisional patent application Ser. No. 60/868,838 entitled “Wavelength Shifted Dynamic Bidirectional System”, filed on Dec. 6, 2006.

PREFERRED EMBODIMENTS & SCOPE OF THE INVENTION

As used in the above disclosed specifications, the above disclosed specifications “/” has been used to indicate an “or”.

As used in the above disclosed specifications and in the claims, the singular forms “a”, “an”, and “the” include also the plural forms, unless the context clearly dictates otherwise.

As used in the above disclosed specifications, the term “includes” means “comprises”. Also the term “including” means “comprising”.

As used in the above disclosed specifications, the term “couples” or “coupled” does not exclude the presence of an intermediate element(s) between the coupled items.

Any dimension in the above disclosed specifications is by way of an approximation only and not by way of any limitation.

As used in the above disclosed specifications, unless otherwise specified in the relevant paragraph(s), a nanoscaled dimension shall generally mean a dimension from about 1 nm to about 1000 nm.

As used in the above disclosed specifications, the word “unit” is synonymous with the word “media unit” or with the word “media”.

As used in the above disclosed specifications, the word cloud based storage unit is synonymous with a cloud based server.

As used in the above disclosed specifications, a hardware module/module is defined as an integration of critical electrical/optical/radio/sensor components and circuits (and algorithms, if needed) to achieve a desired property of a hardware module/module.

As used in the above disclosed specifications, an algorithm is defined as organized set of instructions to achieve a desired task.

As used in the above disclosed specifications, a software module is defined as a collection of consistent algorithms to achieve a desired task.

As used in the above disclosed specifications, real time means near real time in practice.

Any example in the above disclosed specifications is by way of an example only and not by way of any limitation. Having described and illustrated the principles of the disclosed technology with reference to the illustrated embodiments, it will be recognized that the illustrated embodiments can be modified in any arrangement and detail with departing from such principles. The technologies from any example can be combined in any arrangement with the technologies described in any one or more of the other examples. Alternatives specifically addressed in this application are merely exemplary and do not constitute all possible examples. Claimed invention is disclosed as one of several possibilities or as useful separately or in various combinations. SeeNovozymes A/Sv.DuPont Nutrition Biosciences APS,723 F3d 1336,1347.

The best mode requirement “requires an inventor(s) to disclose the best mode contemplated by him/her, as of the time he/she executes the application, of carrying out the invention.” “ . . . [T]he existence of a best mode is a purely subjective matter depending upon what the inventor(s) actually believed at the time the application was filed.” SeeBayer AGv.Schein Pharmaceuticals, Inc. The best mode requirement still exists under the America Invents Act (AIA). At the time of the invention, the inventor(s) described preferred best mode embodiments of the present invention. The sole purpose of the best mode requirement is to restrain the inventor(s) from applying for a patent, while at the same time concealing from the public preferred embodiments of their inventions, which they have in fact conceived. The best mode inquiry focuses on the inventor(s)' state of mind at the time he/she filed the patent application, raising a subjective factual question. The specificity of disclosure required to comply with the best mode requirement must be determined by the knowledge of facts within the possession of the inventor(s) at the time of filing the patent application. SeeGlaxo, Inc. v.Novopharm Ltd.,52 F.3d 1043, 1050 (Fed. Cir. 1995). The above disclosed specifications are the preferred best mode embodiments of the present invention. However, they are not intended to be limited only to the preferred best mode embodiments of the present invention.

Embodiment by definition is a manner in which an invention can be made or used or practiced or expressed. “A tangible form or representation of the invention” is an embodiment.

Numerous variations and/or modifications are possible within the scope of the present invention. Accordingly, the disclosed preferred best mode embodiments are to be construed as illustrative only. Those who are skilled in the art can make various variations and/or modifications without departing from the scope and spirit of this invention. It should be apparent that features of one embodiment can be combined with one or more features of another embodiment to form a plurality of embodiments. The inventor(s) of the present invention is not required to describe each and every conceivable and possible future embodiment in the preferred best mode embodiments of the present invention. SeeSRI Int'lv.Matsushita Elec. Corp. of America,775F.2d 1107, 1121, 227 U.S.P.Q. (BNA) 577, 585 (Fed. Cir. 1985)(enbanc).

The scope and spirit of this invention shall be defined by the claims and the equivalents of the claims only. The exclusive use of all variations and/or modifications within the scope of the claims is reserved. The general presumption is that claim terms should be interpreted using their plain and ordinary meaning without improperly importing a limitation from the specification into the claims. SeeContinental Circuits LLCv.Intel Corp. (Appeal Number 2018-1076, Fed. Cir. Feb. 8, 2019) andOxford Immunotec Ltd. v.Qiagen, Inc. et al., Action No. 15-cv-13124-NMG. Unless a claim term is specifically defined in the preferred best mode embodiments, then a claim term has an ordinary meaning, as understood by a person with an ordinary skill in the art, at the time of the present invention. Plain claim language will not be narrowed, unless the inventor(s) of the present invention clearly and explicitly disclaims broader claim scope. SeeSumitomo Dainippon Pharma Co. v.Emcure Pharm. Ltd., Case Nos. 17-1798; -1799; -1800 (Fed. Cir. Apr. 16, 2018) (Stoll, J). As noted long ago: “Specifications teach. Claims claim”. SeeRexnord Corp. v.Laitram Corp.,274 F.3d 1336, 1344 (Fed. Cir. 2001). The rights of claims (and rights of the equivalents of the claims) under the Doctrine of Equivalents-meeting the “Triple Identity Test” (a) performing substantially the same function, (b) in substantially the same way and (c) yielding substantially the same result. SeeCrown Packaging Tech., Inc. v.Rexam Beverage Can Co.,559 F.3d 1308, 1312 (Fed. Cir. 2009)) of the present invention are not narrowed or limited by the selective imports of the specifications (of the preferred embodiments of the present invention) into the claims.

While “absolute precision is unattainable” in patented claims, the definiteness requirement “mandates clarity.” SeeNautilus, Inc. v.Biosig Instruments, Inc.,527 U.S., 134 S. Ct. 2120, 2129, 110 USPQ2d 1688, 1693 (2014). Definiteness of claim language must be analyzed NOT in a vacuum, but in light of:(a) The content of the particular application disclosure,(b) The teachings of any prior art and(c) The claim interpretation that would be given by one possessing the ordinary level of skill in the pertinent art at the time the invention was made. (Id.).
SeeOrthokinetics, Inc. v.Safety Travel Chairs. Inc.,806 F.2d 1565, 1 USPQ2d 1081 (Fed. Cir. 1986)

There are number of ways the written description requirement is satisfied. Applicant(s) does not need to describe every claim element exactly, because there is no such requirement (MPEP § 2163). Rather to satisfy the written description requirement, all that is required is “reasonable clarity” (MPEP § 2163.02). An adequate description may be made in any way through express, implicit or even inherent disclosures in the application, including word, structures, figures, diagrams and/or equations (MPEP §§ 2163(I), 2163.02). The set of claims in this invention generally covers a set of sufficient number of embodiments to conform to written description and enablement doctrine. SeeAriad Pharm., Inc. v.Eli Lilly&Co.,598 F.3d 1336, 1355 (Fed. Cir. 2010),Regents of the University of Californiav.Eli Lilly&Co.,119 F.3d 1559 (Fed. Cir. 1997) &Amgen Inc. v.Chugai Pharmaceutical Co.927 F.2d 1200 (Fed. Cir. 1991).

Furthermore,Amgen Inc. v.Chugai Pharmaceutical Co. exemplifies Federal Circuit's strict enablement requirements. Additionally, the set of claims in this invention is intended to inform the scope of this invention with “reasonable certainty”. SeeInterval Licensing, LLCv.AOL Inc. (Fed. Cir. Sep. 10, 2014). A key aspect of the enablement requirement is that it only requires that others will not have to perform “undue experimentation” to reproduce it. Enablement is not precluded by the necessity of some experimentation, “[t]he key word is ‘undue’, not experimentation.” Enablement is generally considered to be the most important factor for determining the scope of claim protection allowed. The scope of enablement must be commensurate with the scope of the claims. However, enablement does not require that an inventor disclose every possible embodiment of his invention. The scope of enablement must be commensurate with the scope of the claims. The scope of the claims must be less than or equal to the scope of enablement. SeePromegav.Life TechnologiesFed. Cir., December 2014, Magsilv.Hitachi Global StorageFed. Cir. August 2012.

The term “means” was not used nor intended nor implied in the disclosed preferred beat mode embodiments of the present invention. Thus, the inventor(s) has not limited the scope of the claims as mean plus function.

An apparatus claim with functional language is not an impermissible “hybrid” claim; instead, it is simply an apparatus claim including functional limitations. Additionally, “apparatus claims are not necessarily indefinite for using functional language . . . [f]unctional language may also be employed to limit the claims without using the means-plus-function format.” SeeNational Presto Industries, Inc. v.The West Bend Co.,76 F. 3d 1185 (Fed. Cir. 1996),R.A.C.C. Indus. v.Stun-Tech. Inc.,178 F.3d 1309 (Fed. Cir. 1998) (unpublished),Microprocessor Enhancement Corp.v.Texas Instruments Inc. &Williamsonv.Citrix Online, LLC,792 F.3d 1339 (2015).