Patent ID: 12259363

DESCRIPTION OF EMBODIMENTS

The embodiments provide a system and method for automatically detecting a type of floor in a structure. The type of floor, also referred to throughout as the “flooring type”, refers to the materials and/or structural features of the floor. Examples of different flooring types include, but are not limited to: hardwood flooring, engineered wood flooring, bamboo flooring, laminate flooring, linoleum flooring, cork flooring, ceramic tile flooring, vinyl flooring, stone flooring, concrete flooring, and carpet. While some flooring types can be easily distinguished by visual inspection, such as the distinction between a concrete floor and a hardwood floor, other types may not be easily discernible by inspection. For example, it may be difficult to know if a given floor is a solid hardwood floor, an engineered wood floor, or a laminate floor. In other cases, a floor may comprise a concrete base that is covered by a layer of wood.

The exemplary system comprises an acoustic apparatus that can be placed against a flooring surface to determine the flooring type. The acoustic apparatus can generate sounds using a built-in transducer. Sound waves emanating from the device are filtered through the floor and the resulting filtered sound waves are detected by a microphone disposed adjacent the floor and within the acoustic apparatus. In addition, a second microphone is used to detect ambient noise that can be subtracted from the primary acoustic signal. Signals from both microphones are fed into a mobile computing device, such a smart phone, that can be connected to the device. The mobile computing device further comprises a signal processing module to remove the ambient noise from the primary audio signal, as well as a flooring type classifier for identifying the flooring type based on the input audio signal.

The system and method facilitate improved speed and cost over existing methods that require portions of a floor to be removed and tested in a laboratory. The system and method also facilitate improved accuracy over methods relying on visual inspection. The system and method also provide a consistent system that can be used by homeowners, inspectors, and/or insurance adjusters without the need for any training in visually identifying different flooring types. These improvements help ensure that flooring in a home is properly assessed for homeowner's insurance.

FIG.1is a schematic view of an acoustic apparatus100, also referred to simply as apparatus100. Specifically, in some embodiments, acoustic apparatus may function as part of a flooring type detector that can be used to detect the type of flooring present in a building (such as a home or office building). Apparatus100may comprise a housing102. Housing102may further receive and hold a plurality of different electrical devices that can be used to generate and detect sounds.

Housing102may comprise an upper portion104and a lower portion106. As used herein, the term “lower portion” refers to a portion of housing102that is disposed adjacent a floor when housing102is placed on the floor during the operation of apparatus100. Likewise, the term “upper portion” refers to a portion of housing102that is disposed furthest from the floor in this same operating position. As seen inFIG.2, lower portion106is comprised of a lower surface108interrupted by a first lower opening110and a second lower opening112. By contrast, upper portion104has a relatively open configuration that provides access to multiple different cavities, including a first upper cavity120, a second upper cavity122and a third upper cavity124.

First upper cavity120may include a transducer receiving portion121that is shaped to receive a transducer130. In particular, transducer receiving portion121may include a rounded interior wall123to fit the approximately cylindrical shape of transducer130. Moreover, transducer receiving portion121may extend to first lower opening110, so that a part of transducer130may be exposed on lower surface108(seeFIG.2).

Second upper cavity122may be configured to receive a portable computing device. Examples of portable computing devices that could be received within second upper cavity122include, but are not limited to, smart phones, tablet computing devices or other suitable computing devices. In one embodiment, second upper cavity122could receive a smart phone that can be connected to one or more electronic devices associated with apparatus100.

Third upper cavity124may be configured to receive one or more circuit components140, which are indicated schematically inFIG.1. These circuit components may facilitate the operation of one or more electrical devices associated with apparatus100. These can include, for example, a first microphone150and a second microphone152. In some cases, circuit components140may include circuit elements to facilitate powering and/or receiving signals from first microphone150and second microphone152.

In some embodiments, third upper cavity124is dimensioned to accommodate first microphone150. Specifically, first microphone150may be mounted within third upper cavity124. In some cases, first microphone150may be mounted so that a portion of first microphone150is exposed through second lower opening112(seeFIG.2).

In operation, second microphone152may be mounted to housing102in a location that is separated from first microphone150. For example, in some cases, second microphone152may be mounted closer to upper portion104of housing102, while first microphone150is mounted to lower portion106. Moreover, in some cases, first microphone150and second microphone152may be oriented in different directions. Specifically, first microphone150may be oriented to primarily pick up sounds coming from the floor, while second microphone152may be oriented to primarily pick up ambient sounds (that is sounds not emanating from the floor) while the apparatus is in use. Thus, in some cases, first microphone150may be oriented down towards a floor, while second microphone152may be oriented up or otherwise away from the floor, while the device is in operation.

For purposes of illustration, first microphone150and second microphone152are shown schematically. The embodiments may incorporate any kinds of microphones known in the art. These include, but are not limited to: condenser microphones, electret condenser microphones, dynamic microphones, ribbon microphone, contact microphone, as well as any other suitable kinds of microphones.

Apparatus100can incorporate provisions for connecting the different electrical devices to external components and/or to one another. As seen inFIG.1, wires170can be used to deliver a signal to transducer130. In some embodiments, wires170are connected to an audio connector172that can be plugged into the audio output port of any suitable device, such as a radio, mobile phone, MP3 player or other device capable of generating an audio signal. In addition, wires180and wires182can be used to connect first microphone150and second microphone152, respectively, to circuit components140. That is, audio information detected by the microphones can be passed to circuit components for processing and/or for relaying those signals to another device. Wires190can be used to connect circuit components140with a portable computing device, such as a smart phone. In some embodiments, a smart phone connector192can be used to connect to a corresponding port in a smart phone. In one embodiment, connector192may be a lightning connector. In other embodiments, connector192could be a micro-USB connector.

FIG.3is a schematic view of apparatus100in operation with a portion of a generic floor301, according to an embodiment. In this embodiment, housing102is shown in cross-section in order to clarify the operation of several internal components. Specifically, transducer130, first microphone150and second microphone152are all visible within housing102. Additionally, a portion of a smart phone302that would otherwise be concealed by housing102is also visible. When assembled with a smart phone302, acoustic apparatus100and smart phone302may be collectively referred to as a flooring type detection system.

As seen inFIG.3, wires190are connected to smart phone302. This allows smart phone302to receive audio signals (and/or other information) from first microphone150and second microphone152through wires180and wires182, respectively. Additionally, transducer130may be connected to either smartphone302or an external audio source using wires170and audio jack172(seeFIG.1). In embodiments where smartphone302is used to drive transducer130, incoming and outgoing signals could be transmitted via connector192and wires190. Alternatively, both audio jack172and connector192could be connected to smartphone302. For example,FIG.15shows another embodiment where a connector1502and an audio jack1504are integrated into an upper cavity1500of a portion of housing1501of another embodiment of an acoustic apparatus400. Connector1502can receive audio signals from microphones and/or other circuit components via wires1508. Connector1502could be any known connector, such as a lightning connector, a micro-USB connector, or any other suitable connector. Audio jack1504may be connected to a transducer to drive the transducer.

In operation, smartphone302generates an audio signal that is sent to transducer130. Transducer130converts the electrical signal from an audio source (such as smartphone302or an external audio source) into vibrations that generate sound waves310. In some cases, transducer130may actually vibrate lower portion106, which shakes and generates sound waves310. In other cases, the sound waves are primarily generated at transducer130itself.

These sound waves310travel through floor301. The material comprising floor301acts to filter sound waves310, thereby generating filtered sound waves320that may be detected by first microphone150. At the same time that first microphone150is detecting filtered sound waves320, second microphone152is detecting ambient sound waves330(that is, ambient noise). Audio signals associated with both the filtered sound waves320and the ambient sound waves330are then received at smart phone302and processed as described in further detail below.

FIG.4is a schematic view indicating how information generated by apparatus100may be processed within a flooring type detection system. In this example, audio signals may be processed by software modules disposed in a smart phone (such as smart phone302) or any other computing device that is connected to apparatus100during operation. In other embodiments, however, one or more processing modules could be incorporated into other components associated with apparatus100. These could include separate circuit boards or other integrated processing devices.

As seen inFIG.4, a first audio signal402associated with the floor microphone (for example, first microphone150) and a second audio signal404associated with the ambient noise microphone (for example, second microphone152) are fed into a signal processing module410. In some embodiments, signal processing module410could be a software module configured to run within an application415on smart phone302. The processed signal generated by signal processing module410is then fed into a flooring type classifier420. In some embodiments, flooring type classifier420may be configured to run within an application on smart phone302. Alternatively, one or both of signal processing module410and flooring type classifier420could run on a remote server or cloud service, which may be accessed by smart phone302over a network such as the Internet.

FIG.5is a schematic view of how audio information is processed in order to classify a signal. It may be appreciated that in some embodiments one or more of these steps could be performed by an application running on a smart phone. Starting in step502, a signal processing module may receive a first audio signal from a floor microphone. That is, the first audio signal includes sound information received while the apparatus is operated. In step504, which may occur simultaneously with step502, the signal processing module may receive a second audio signal from an ambient microphone. That is, the second audio signal includes ambient sound that is present while the apparatus is operated. Next, in step506, the signal processing module may remove the ambient noise from the first audio signal. In some cases, this step may comprise subtracting the second audio signal from the first audio signal. In other cases, any suitable algorithm for filtering out one signal from another could be used. Finally, in step508, a flooring type classifier may classify the audio signal that has been processed in step506using a machine learning model.

FIG.6is a schematic view of a flooring type classifier600, as well as possible inputs and outputs. Flooring type classifier600may include any suitable machine learning algorithms. Exemplary machine learning algorithms that may be used include, but are not limited to: supervised learning algorithms and unsupervised learning algorithms. In some embodiments, a decision tree could be used. In some embodiments, a random forest model could be used. In another embodiment, a clustering algorithm could be used. In still other embodiments, a neural network could be used. In still other embodiments, a regression model could be used.

Flooring type classifier600may receive a detected signal602as input and generate a flooring type604as output. When the system is being trained, known flooring type training data606for each detected signal could also be provided as input.

FIGS.7-9depict schematic views of output signals for three different flooring types. It may be appreciated that the particular audio signals shown in these figures are simplified for clarity. In each of these figures, apparatus100is disposed against a portion of a floor and operated to detect the flooring type. Specifically, transducer130is driven to generate sounds that vibrate the adjacent floor, and first microphone150and second microphone152are used to detect the resulting filtered sound waves along with ambient noise. Then, the signals are processed by smart phone302as described above.

As shown inFIG.7, upon driving transducer130according to an input audio signal702, a first type of flooring750generates sound waves corresponding to a first processed audio signal704. As shown inFIG.8, when the same input signal702is used to drive transducer130, a second type of flooring850generates sound waves corresponding to a second processed audio signal804. As seen by comparingFIGS.7and8, second processed audio signal804is substantially distinct from first processed audio signal704. As shown inFIG.9, when the same input signal702is used to drive transducer130, a third type of flooring950generates sound waves corresponding to a third processed audio signal904. As seen by comparingFIGS.7,8, and9, third processed audio signal904is substantially distinct from both first processed audio signal704and second processed audio signal804. Thus, the fact that each flooring type is associated with a different characteristic output signal, makes it possible for a flooring type classifier to identify the flooring type according to the output signal. For example, based on the processed audio signal704, a flooring type detector may identify the first type of flooring750as hardwood. Based on the processed audio signal804, a flooring type detector may identify the second type of flooring850as a concrete floor with a wood panel covering852. Based on the processed audio signal904, a flooring type detector may identify the third type of flooring950as a laminate floor.

In other embodiments, an acoustic apparatus may not include a separate transducer. Instead, the acoustic apparatus could utilize speakers in a smartphone or similar device.

FIGS.10-13illustrate views of another embodiment of an acoustic apparatus that may be used as a flooring type detector. In particular,FIGS.10and11show an acoustic apparatus1002according to one embodiment of the present invention having an enclosure1004that has a rectangular box shape.FIG.10shows an exterior1006of enclosure1004andFIG.11shows an interior1008and an open side1010of enclosure1004.

As shown inFIG.10, enclosure1004has a body portion1012including recess1014for receiving an end1016of a smartphone1018at a slanted angle, indicated by dashed lines1020. Extending from long side1022and long side1024of body portion1012are long side wall1026and long side wall1028, respectively. Extending from short side wall1032and short side wall1034of body portion1012are short side wall1036and short side wall1038, respectively. As shown inFIG.11, free end1042and free end1044of long side wall1026and long side wall1028, respectively and free end1046and free end1048of short side wall1036and short side wall1038, respectively, together form a distal perimeter edge1052of enclosure1004. Distal perimeter edge1052surrounds open side1010of enclosure1004. As shown inFIG.11, body portion1012has an interior surface1060on which is mounted a microphone1062(seeFIG.12) and an electrical connection1064. Electrical connection1064electrically connects microphone1062to an electrical connector (not shown inFIGS.10and11) in recess1014. When smartphone1018is inserted in recess1014, an electrical connector (not shown inFIGS.10and11) at end1016electrically connects to the electrical connector in recess1014to thereby put microphone1062in electronic communication with smartphone1018.

FIG.12shows how acoustic apparatus1002can be used to determine the composition of floor1210. Open side1010of enclosure1004of acoustic apparatus1002is placed on floor1210to produce an enclosed region1212formed by enclosure1004and floor1210. In one embodiment of the present invention, enclosed region1212is acoustically isolated from environment1214outside enclosed region1212. A speaker (not shown inFIG.12) of smartphone1018mounted in recess1014emits emitted sound waves1224of various frequencies through opening1222in a bottom side1226of recess1014. Emitted sound waves1224vibrate floor1210thereby causing floor1210to vibrate and filter emitted sound waves1224. This results in the production of filtered sound waves1230that are received by microphone1062. The type of material floor1210is made of will affect the filtered sound waves that are produced by floor1210in response to emitted sound waves1224. For example, softer materials used in floor1210will tend to better transmit lower frequency sound waves from emitted sound waves1224in filtered sound waves1230. Conversely, harder material used in floor1210will tend to better transmit higher frequency sound waves from emitted sound waves1224in filtered sound waves1230. Microphone1062sends information about filtered sound waves1230to smartphone1018through electrical connection1064(not shown inFIG.12). Based on stored sound wave profile information about different types of flooring materials in the memory of smartphone1018, the amplitude of each frequency in emitted sound waves1224and the amplitude of each frequency in filtered sound waves1230, hardware and/or software in smartphone1018determines the composition of floor1210.

Although in the embodiment of the present invention shown inFIG.12, the smartphone used to produce the emitted sounds waves is used to determine the type of material or materials used in the flooring, in other embodiments of the present invention, the microphone may be connected to another electronic device such as another smartphone, tablet-type device, laptop, etc. that is used to determine the type of material or materials used in the flooring being analyzed by the acoustic apparatus.

FIG.13shows an insert1302for mounting a smartphone (not shown inFIG.13) in a body portion1310of an acoustic apparatus1312according to one embodiment of the present invention. Insert1302is inserted in an opening1322of body portion1310. Opening1322includes with a slanted wall1326and a vertical wall1328. Opening1322also includes a vertical wall1336and a vertical wall1338. Opening1322includes a ledge1342where vertical wall1336is joined to slanted wall1326and a ledge1344where vertical wall1338is joined to vertical wall1328. Insert1302includes a top portion1352and a narrower bottom portion1354shaped so that when insert1302is inserted into opening1322, insert1302mates with opening1322. As shown inFIG.13, when insert1302is inserted in opening1322, a lower ledge1356of top portion1352abuts ledge1342of opening1322and a lower ledge1358of top portion1352abuts ledge1344of opening1322. Insert1302includes a recess1362for receiving an end of a smartphone (not shown inFIG.13). Extending through a slanted opening1364in bottom portion1354of insert1302is an electrical connector1366for connecting to an electrical connector (not shown inFIG.13) of a smartphone inserted in recess1362. Electrical connector1366is connected to a microphone (not shown) by an electrical connection1368.

In another embodiment, an acoustic apparatus could incorporate a transducer, but not a separate microphone. Instead, the microphone of a smartphone operable with the acoustic apparatus could be used to detect sound waves generated by a floor.

FIG.14shows an acoustic apparatus1402according to one embodiment of the present invention being used to determine the composition of a floor1408. Acoustic apparatus1402includes an enclosure1410and a surface transducer1412. Enclosure1410has a body portion1414and four side walls1416, only two of which are shown inFIG.14. Enclosure1410includes an open side1418. Body portion1414includes a recess1420in which is inserted a smartphone1422.

As shown inFIG.14, open side of enclosure1410of acoustic apparatus1402is placed on floor1408to produce an enclosed region1424formed by enclosure1410and floor1408. In one embodiment of the present invention, enclosed region1424is acoustically isolated from environment1428outside enclosed region1424. Surface transducer1412of acoustic apparatus1402on floor1408transmits vibrations, indicated by double-headed arrow1426, into floor1408to vibrate floor1408to thereby cause floor1408to produce filtered sound waves1430. Filtered sound waves1430pass through an opening1432in recess1420and are received by a microphone (not shown inFIG.14) of smartphone1422.

The type of material floor1408is made of will affect what type of filtered sound waves are produced by floor1408in response to the vibrations transmitted to the floor1408by surface transducer1412. For example, some materials used in floor1408will tend to better transmit lower frequency sound waves in filtered sound waves1430. Conversely, harder material used in floor1408will tend to better transmit higher frequency sound waves in filtered sound waves1430. Based on stored sound wave profile information about different types of flooring materials in the memory of smartphone1422, the amplitude in the vibrations transmitted by surface transducer1412into floor1408and the amplitude of each frequency in filtered sound waves1430, hardware and/or software in smartphone1422determines the composition of floor1408. The operation of surface transducer1412may be controlled by smartphone1422via a wireless or a wired connection (not shown inFIG.14).

FIG.16is a schematic view of another embodiment of an acoustic apparatus1600that is remotely connected to a smartphone1650. Referring toFIG.16, acoustic apparatus1600includes a speaker (or transducer)1602for generating sound waves. Additionally, apparatus1600includes contact microphone1610. When using a contact microphone, which will not pickup significant ambient noise, a second microphone for detecting ambient noise may not be necessary.

Speaker1602is connected to a microcontroller1604via wires1620. Microcontroller1604may include provisions for generating sounds that can be played by speaker1602. This allows an audio signal to be generated by speaker1602without the need for a separate device that can generate sound, such as a smartphone.

Apparatus1600may also include a Bluetooth chip1608for communicating with smartphone1650. Bluetooth chip1608may receive signals from contact microphone using wires1624. This allows signals detected by contact microphone1610to be sent to smartphone1650over Bluetooth chip1608for further analysis. In some cases, it is also possible for audio signals sent by smartphone1650to Bluetooth chip1608, to be sent to microcontroller1604using wires1621. For example, audio signals could be sent by smartphone, pass through microcontroller, and end up at speaker1602. Optionally, instead of a Bluetooth chip, other systems enabling wireless communications between smartphone1650and other components of acoustic apparatus1600could be used.

Acoustic apparatus1600may also include a rechargeable battery1606for powering one or more onboard components. In this example, rechargeable battery1606powers microcontroller1604via wires1622. Also, rechargeable battery1606powers Bluetooth chip1608via wires1623.

The configuration shown inFIG.16allows acoustic apparatus1600to operate as a self-contained device that can be wirelessly coupled with a smartphone or other computing device. It may be appreciated that in other embodiments, one or more of these components could be optional. Moreover, in other embodiments, elements of the present embodiment could be combined with elements of previous embodiments, including the embodiment shown inFIGS.1-2.

The enclosure of the present invention may be made of various materials such plastic, rubber, etc. that will not significantly affect the filtered sound waves produced by the surface covering.

In one embodiment of the present invention the distal perimeter edge of the enclosure may have a resilient material such as silicone, rubber or plastic layer coated on the distal perimeter edge of the enclosure. In another embodiment of the present invention, the distal perimeter edge of the enclosure may have a layer of a resilient layer mounted on the distal perimeter edge of the enclosure using an adhesive, screws or other fixing means. The resilient layer may be made of felt, plastic, rubber, etc.

Although in the embodiments of the present invention shown in the drawings and described above the acoustic apparatus is shown being used to determine the composition of a flooring material, the acoustic apparatus of the present invention may also be used to identify the materials used in other types of surface coverings such as walls, ceilings and roofs. When used to identify the materials used surface coverings such as walls, ceilings and roofs, the enclosure may be held in place on the surface covering manually or may include suction cups or other means to hold the enclosure in place a vertical or upside down position on the surface covering.

When used to identify the materials used surface coverings such as walls, ceilings and roofs, the surface transducer may be mounted in a case including suction cups or other means to hold the surface transducer in place a vertical or upside down position on the surface covering.

Although in the embodiments of the present invention shown in the drawings and described above, the enclosure has the shape of a rectangular box with two short sides and two long sides, the enclosure of the present invention could have a square-shaped body portion with all of the sides being the same length. Also, although in the embodiments of the present invention shown in the drawings and described above, the enclosure has the shape of an open rectangular box, an enclosure of the present invention may have various different shapes. For example, the enclosure could be in the shape of an open disc-shaped cylinder, in which case the body portion would be circular in shape with a single cylindrical wall extending from the body portion. In other embodiments of the present invention the enclosure could have: a triangular body portion and three side walls, a pentagonal body portion with five side walls, a hexagonal body portion with six side walls, etc.

While various embodiments of the invention have been described, the description is intended to be exemplary, rather than limiting, and it will be apparent to those of ordinary skill in the art that many more embodiments and implementations are possible that are within the scope of the invention. Accordingly, the invention is not to be restricted except in light of the attached claims and their equivalents. Also, various modifications and changes may be made within the scope of the attached claims.