A formal system of mathematics the dog-ears, is introduced to describe javascript or object notation, sensor event and action event with state modelling in the framework of DPA for a smart home and work robotics . It is assumed that a multi modal interface can be developed similar to AWS APL for this purpose. The RAVA natural programming language is introduced, which simplifies coding by eliminating the need for syntax. © AB, All rights reserved. Keywords: ​ Smart Home Automation, AWS Alexa, Dog-Ears, Formal System Introduction What: Formal Method for creation of state machine and flexible rule based DPA, with a formal definition of sensor streams, sensor events and action events. A mathematical and natural programming formal model for a smart connected home. How: dog-ear ​ , a formal system of event based logic and sensor fusion, is described in an axiomatic framework. So what: dog-ear forms the axiomatic formulation of RAVA, a natural and mathematical programming language , illustrated with Alexa blueprints for APL based skills for a connected home. Beyond the connected home, the same framework can be used for business and work automation skills. Axiom 001 ​ ; There exists a stream s for every sensor a, integrated in a connected model M. 1 Dr Bheemaiah, Anil Kumar. |Formal Methods for Multi Modal UI for Robotics Axiom 002 ​ ; Two or more streams, si can be merged into a single stream in sensor fusion. Axion 003 ​ : There exist events ei as features extracted from a stream s, called event ei(s), the event-sensor space. Axiom 004 ​ : There exist events ei as actions defined in the action-event space Ai. Theorem 001: In an I.O.T definition of sensor and action integration, there exist separate or combined controls Ci for a connected home. Ci defines sensor-events, sensor-streams and action-events for cloud integration. Theorem 002: There exists a MUI, as part of a RAVA agent, with a state machine, and a rule engine, for a state based control of Ci, residing in the cloud. The MUI, re and s are defined in the cloud and executed in remote hardware than the home automation. Theorem 003: The rule engine and the state machine are sufficient in the existence of a flexible rule framework to automate all smart home tasks. In the event of any exception ei, manual intervention with the addition of data gathering to the cloud, there thus exists machine learning for rule formulation based on data for all ei. Theorem 004: ​ Wisdom Capital and expert systems. Data mining and a data repository of exceptions ei and data(ei) lead to associations of an expert system, with knowledge data-structures KM. KM is persisted to machine DNA which holds a new emergence of machine ‘common sense’, called Wisdom Capital. Wisdom Capital. Wisdom Capital is machine DNA encrypted knowledge management that delineates all designs and machine learning. This enables the metaphorical staircase to Singularity#1, the design of DPA rules for automated and self learning automation systems. Fig 1: Abstract Surrealism, a symbol of the present SQL table like thinking, to be replaced by a void, denoting associative memory in the digit zero. Discussion An event based formal system is defined for a multi modal UI interface with cloud functions using Amazon AWS as an illustration . A comparison with other formal systems, (Pommaret, Haddak, and Bendiab 1989; Torbensen 2008) indicate various approaches that range from 2 Dr Bheemaiah, Anil Kumar. |Formal Methods for Multi Modal UI for Robotics field based nonlinear dynamical systems, to propositional calculus based systems which include many propositional logic based calculi for discrete event programming in home and work automation. ​ (Hutter 2006; Bringsjord 2013) A DNA representation for encoding digital human and robotic machines will usher a new era of optronic based robotics. Soul machines is one of the early pioneers in this direction. ​ (Makari 2015; Kurzweil 2000; Fisher 2012) (Makari 2015; Kurzweil 2000; Fisher 2012) ​ tal is a close formulation of common sense in A.I . Introduced in this publication, ​ (Naidenova and Xenia 2009; Mueller 2014; Minsky 2007; Sun 1994; Friedman, Forbus, and Sherin 2018; McCarthy and Lifschitz 1990) There has been a plethora on formalizing common sense, with many early attempts at creating a A.I usable data set for common sense reasoning and the knowledge models required for common sense perception in conversational UI. Present practical systems make use of wiki-data and a plethora of publicly available data sources. Wisdom Capital is a superset of commonsense reasoning, including heuristics for natural and machine based reasoning. Conclusion and Future Work. We have described a formal system for event and model programming with a DPA framework for robotic automation with external control of retro hardware using RetroSwitches(™). As an example we have described the use of Pega, Twilio and AWS Alexa and Lambda@Edge/Lambda in the creation of Alexa Business skills. Future Work is in the form of an EdTech experiment, A-633 a course in the use of low code solutions to use Dog-Ears in creating Alexa Skills for retro home automation and with most auto-pilot enabled work machines, with a demonstration in afforestation.