Model Comparison of Beer data classification using an electronic nose
Authors: Mohammed Abdi
Aminat Adebiyi
Andrea Fasoli
Alberto Mannari
Ronald Labby
Luisa Bozano
Venue:  (2020)
Keywords: Electronic Nose
EVA
modular
olfaction
sensitivity
selectivity
analyte
temperature oscillated waveforms
features
fingerprint

Abstract: Olfaction has been and still is an area which is challenging to the research community. Like other senses of the body, there has been a push to replicate the sense of smell to aid in identifying odorous compounds in the form of an electronic nose. At IBM, our team (Cogniscent) has designed a modular sensor board platform based on the artificial olfaction concept we called EVA (Electronic Volatile Analyzer). EVA is an IoT electronic nose device that aims to reproduce olfaction in living begins by integrating an array of partially specific and uniquely selective smell recognition sensors which are directly exposed to the target chemical analyte or the environment. We are exploring a new technique called temperature-controlled oscillation, which gives us virtual array of sensors to represent our signals/ fingerprint. In our study, we run experiments on identifying different types of beers using EVA. In order to successfully carry this classification task, the entire process starting from preparation of samples, having a consistent protocol of data collection in place all the way to providing the data to be analyzed and input to a machine learning model is very important. On this paper, we will discuss the process of sniffing volatile organic compounds from liquid beer samples and successfully classifying different brands of beers as a pilot test. We researched on different machine learning models in order to get the best classification accuracy for our Beer samples. The best classification accuracy is achieved by using a multi-level perceptron (MLP) artificial neural network (ANN) model, classification of three different brands of beers after splitting one-week data to a training and testing set yielded an accuracy of 97.334. While using separate weeks of data for training and testing set the model yielded an accuracy of 67.812, this is because of drift playing a role in the overall classification process. Using Random forest, the classification accuracy achieved by the model is 0.923. And Decision Tree achieved 0.911. 

Under review as a conference paper at ICLR 2020
MODEL COMPARISON OF BEER DATA CLASSIFICATION USING AN ELECTRONIC NOSE
Anonymous authors Paper under double-blind review
ABSTRACT
Olfaction has been and still is an area which is challenging to the research com- munity. Like other senses of the body, there has been push to replicate the sense of smell to aid in identifying odorous compounds in the form of an electronic nose. At IBM, our team (Cogniscent) has designed a modular sensor board plat- form based on the artificial olfaction concept we called EVA (Electronic Volatile Analyzer). EVA is an IoT electronic nose device that aims to reproduce olfaction in living begins by integrating tive smell recognition sensors which are directly exposed to the target chemical analyte the environment. We exploring a new technique called temperature controlled oscillation, which gives us virtual array of sensors to represent our sig- nals/ fingerprint. In our study, of beers using EVA. In order to successfully сarry this classification task, the en- tire process starting from preparation of samples, having a consistent protocol of data collection in place all the way to providing the data to be analyzed and in- put to a machine learning model is very important. On this paper we will discuss the process of sniffing volatile organic compounds from liquid beer samples and successfully classifying different brands of beers as a pilot test. We researched on different machine learning models in order to get the best classification accu- racy for our Beer samples. The best classification accuracy is achieved by using multi-level perceptron (MLP) artificial neural network (ANN) model, classifica- tion of three different brands of beers after splitting one-week data to a training and testing yielded an accuracy of 97.334. While using separate weeks of data for training and testing set the model yielded an accuracy of 67.812, this is be- cause of drift playing role in the overall classification process. Using Random forest, the classification accuracy achieved by the model is 0.923, And Decision Tree achieved 0.91
array of partially specific and uniquely selec-
experiments
identifying different types
INTRODUCTION
From the five major human senses, olfaction is the most complex sense to be understood completely. Olfaction in an electronic nose has been studied since the 1960s and the term electronic nose was first used in 1988 [1]. An electronic nose device that mimics the olfaction system living beings, particularly humans by integrating chemical smell array of sensors and a machine learning algorithm to learn the patterns/ fingerprints of an odor and correctly classify the respected odor as such [2]. Initially the approach that was embraced in the gas sensing field was a one sensor for one odor type approach, as illustrated by the narrow gaussians on Figure 1. Using this approach, each sensor is very specific to a given odor. However, this was found to be a limiting approach, and it is also very challenging to fabricate highly selective sensors [3].
A much more powerful approach, is to rely partially specific sensors, as illustrated by the graph on Figure 2 [4]. Each sensor has some specificity, but the sensors do overlap. this case, whats important is the aggregate responses of each of the sensors which creates unique fingerprint when combined. The number of sensors in the array depends on the application targeted.
There is a large range of applications where an electronic gases surround us all the times, and they are involved so many processes [5]. Just to name a few general use cases,
be beneficial, simply because
think of food agricultural industry where electronic nose could help

---

Under review as a conference paper at ICLR 2020
Sensor
Sensor
2
Response
R2
Odor A
Odor B
One odor = one sensor
Example: CO2 detector
Figure 1: Narrow gaussians representing one sensor for one odor type approach
Sensor
Sensor
Response
Odor A Odor B
One odor Many sensors
One sensor= Many odors
Creates unique fingerprint of odor
Figure 2: Wide gaussians representing overlap between sensors
detect food spoilage, and limit food wastage, crypto anchor and block chain, air quality monitoring in industrial or automotive spaces, process monitoring and standardization in the pharmaceutical or chemical industries, and healthcare, where enabling the early detection of diseases could save many lives.
In this paper, we discuss in detail an electronic nose device we called Electronic Volatile Analyzer (EVA). EVA currently the research phase being developed under a team called Cogniscent in IBM Almaden Research Center. On this study, we used EVA to study and classify different brands of becrs based on their volatiles they emit.
SYSTEM DESCRIPTION
The proposed electronic nose, Electronic Volatile Analyzer (EVA) was developed by IBM research team. In IBM research, the team researches three very important areas enhance the devel-
2

---

Under review as a conference paper at ICLR 2020
Food Agrioulturt
Industrial Safety/ Environment
Automotive
Pharmaceutial Chemical standariiation
Healthaaee
Figure 3: Impact of gas detection technology on different applications
opment of an electronic nose. Material, hardware and analytics (machine learning or Artificial Intelligence (AI)).
EVA is designed in house to fit the specification of an electronic nose which modular, tunable, portable and scalable with low cost electronic components. EVAs modular architecture allows for the integration of more sensors depending on the application targeted. sensor is mounted on its own module and operated in novel ways to extract relevant information and optimize sensitivity and selectivity. Each sensor is operated in a temperature oscillated wave form by applying a voltage to the heater to form one sequence. And multiple examples collected in such way for training. The BeagleBone serves as a central hub device, where the processing and integration of all the data from the array of sensors is happening and it communicates with a I2C protocol with the sensor modules. The platform is agnostic of sensors technology. which means we can add other types of sensors such as temperature, humidity sensors enhance the Al intelligence and aid with more information. The system is fully integrated and independent. EVA communicates with the cloud using a Wi-Fi connection and this provides various advantages such as centralized processing, online storage and supporting complex algorithms.
The data collected by EVA is preprocessed and analyzed to extract relevant information that helps in the differentiation of the odors being detected to create a finger print. Once the features are extracted, the next step is the machine learning algorithms, the information fed into a machine learning model for training which takes days to collect good data with enough number of examples to train the model. Once the model is trained, whenever EVA is exposed to sample that its trained on but fresh sample EVA never was exposed to initially, EVA will respond with the correct label for that smell.
gas outlet
pump
hub
gas
EVA sensor modules
Figure 4: Electronic Volatile Analyzer (EVA) e-nose device
3 METHODS
3.1 DATA ACQUISITION
When collecting data, protocol of data collection is very important as determines the reproducibil-
ity of the training data to have good model for training the artificial network. The setup we use for
3

---

Under review as a conference paper at ICLR 2020
data collection is automated to collect multiple examples of data in controlled mechanism. The setup has an auto-vial selector, to select vials based on the time and sequence of data collection. Some protocol we follow and make sure that they are always at the same level before we start mea- suring the required measurements are the temperature of our samples, the flow of the system, the gap between the syringe and the sample etc. In such automated way collect multiple examples of our samples over night or throughout the day for multiple days and we prepare the data for training.
Figure 5: Setup of data collection with Electronic Volatile Analyzer (EVA) e-nose device
Data is collected from three different brands of beers, Urquell which is pale lager with alcohol content of 4.4 percent, Lagunitas is craft brewery with an alcohol content of 6.2 percent and Race hoppy IPA brewed with malted barley, wheat and crystal malts with alcohol content of 7.5 percent. All samples are poured into a vial and only the head-space is measured as seen from figure 5. And we collect data from lab air from separate vial as baseline.
3.2
DATA PROCESSING
After the data is collected using the setup and method described above, the data ready for prepro- cessing before being fed to machine learning model. This is one of the stages where most of the time is spent, because extracting relevant information and features that help for the differentiation and classification of different samples is very important to learn patterns for the machine learning model. We extract different types features from our raw input data. The way we process our data is follows: separate the transitions from the sequences for all the sensors and chunk the transition, which is a voltage drop or gain from two different voltage values.
And we extract mean value and slope value from each chunk. We chunked transition in to five ways for this study and we extracted two features from each chunk, therefor we get ten features from every transition. The total number of features depend the aggregate number of transitions from each sensor. Finally, after stitching all the features from all sensors, all the samples are labeled according their ground truth labels and all the examples are stitched together have final training set which is the total number of examples by the number of features plus the labels.
3.3 MACHINE LEARNING RESULTS
On this study we used multi-level perceptron (MLP) artificial neural network (ANN) model. We had our input layer, two hidden layers and an output layer. For the first experiment, we collected data for one full week, and split the data into 70 percent training set and 30 percent testing set, train the model with the training data. The model further splits the data to 85 percent actual training set and 15 percent testing set. The model took 198 epochs to finish training and it achieved 100
4

---

Under review as a conference paper at ICLR 2020
x10
transition
Figure 6: An example of temperature oscillated sensor read-out from sensor
10
1000
2000
3000
4000
5000
6000
7000
8000
9000
Figure 7: An example of a temperature oscillated sensor read-out from a sensor chunked to equal parts per transition, which will be 30 chunks for the whole sequence from this sensor
percent accuracy with learning rate 0.25 and regularization parameter and mini-batch size of 1 (see figure 8).
After training we further tested the model with the remaining 30 percent data, we kept from the data collected, which is the final days of data from that week and the model achieved 97.334 percent accuracy by correctly classifying the different brands of beers plus lab air.
For the second experiment we kept the conditions the same, but continued collecting data for another week and we used the first week data as a training set and the second week data as a testing set and it yielded 67.812 12 percent. For this specific our research studies the reason is because drift. And this is because of multiple factors playing a role, such as sample changing through time, sensors not starting from the same baseline etc.
see the accuracy dropping and based on

---

Under review as a conference paper at ICLR 2020
Figure Epoch accuracy test Beer one- meek data
Figure 9: Mean squared error prediction ground truth
BEER UNQURIL
0.98
0.02
0.00
0.8
0.6
BEER Pypee 23 RACES
0.4
0.95
0.04
0.01
0.2
BEER 1:
BEER Tyme URQUELL
BEER Type RACES
LAGUNITAS
Figure 10: Confusion matrix different brands of beer plus lab air one-week data

---

Under review as a conference paper at ICLR 2020
1.0
0.8
0.6
BEER Type RACES
0.4
0.2
BEER Pype 1: LAGUNITAS
0.60
0.35
0.05
0.0
BEER Type 1: LAGUNITAS
BEER Type URQUELL
BEER Type RACES
Predicted labey
Figure 11: Confusion matrix of different brands of beer plus lab air two-weeks data
CONCLUSION
In this study, portable electronic device is introduced and the device called EVA is used to classify between different brands of beers. And as seen from the experiment results using an electronic nose for identification of different substances based their smell very promising.
REFERENCES
[1] Gardner, J.W.: Bartlett, P.N.; Dodd, G.H.; Shurmer, H.V. Pattern Recognition the Warwick Electronic Nose. In Proceedings of the 8th International Congress of European Chemoreception Research Organisation, University of Warwick, UK, 1822 July 1988.
[2] A. Bermak, S. Belhouari, M. Shi, and D. Martinez, Pattern Recognition Techniques for Odor Discrimination in Gas Sensor Array, The Encyclopedia of Sensors. American Scientific Publish- ers, 2005.
[3] J. Lozano, J. Santos, and M. Horrillo, Classification of white wine aromas with an electronic nose, Talanta, vol. 67, no. 3, pp. 610 616, 2005..
D. L. Garzia-Gonzalez, N. Barie, M. Rapp. and Aparicio, Analysis of virgin olive oil volatiles by novel electronic nose based miniaturized saw sensor array coupled with spme enhanced headspace enrichment, Journal Agricultural and Food Chemistry, vol. 52, no. 25, pp. 74757479, 2004.
J.-L. Blanco, J. G. Mouroy, J. Gonzalez-Jimenez, and A. Lilienthal, A kalman filter based ap- proach to probabilistic gas distribution mapping.in 28th Symposium On Applied Computing (SAC), mar. 2013, pp. 217222.
[6]. Haugen, J.-E.; Kvaal, K. Electronic nose and artificial neural network. Meat Sci. 1998, 49, S273S286
[7]. Pan, C.-H;; Hsich, H.-Y.; Tang, K.-T. An analog multilayer perceptron neural network for portable electronic nose. Sensors 2012, 13, 193207.
[8]. Depari, A.; Flammini, A.; Marioli, D.; Sisinni, E.; Comini, E.; Ponzoni, A. An electronic system to heat mox sensors with synchronized and programmable thermal profiles. IEEE Trans. Instrum. Meas. 2012, 61, 23742383.
[9]. Pioggia, G.; Ferro, M.; Francesco, F. Towards a real-time transduction and classification of chemoresistive sensor array signals. IEEE Sens. J. 2007, 7, 237244.

---

Under review as a conference paper at ICLR 2020
[10]. Doleman, B.J.; Severin, E.J.; Lewis, N.S. Trends in odor intensity for human and electronic noses: Relative roles of odorant vapor pressure vs. molecularly specific odorant binding. Proc. Natl. Acad. Sci. USA 1998, 95, 54425447.
8


Reviews:
[{"review_id": "HJgZHiyqYS", "reviewer": "AnonReviewer2", "summary": "", "questions": "", "limitations": "", "rating": 1, "confidence": null, "soundness": null, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "Main comments:\nQuality: This paper reads like a project report rather than a typical ICLR paper. It describes a direct application of naïve learning tool (random forest and neural network) without sufficient insight.\n\nClarity: In general, the descriptions on data collection and training are clear.\n\nOriginality: The novelty of this work is very limited, if any.\n\nContributions:\nThe contribution are limited. If the main contributions lie it the construction of the device, I suggest a resubmission to a device-related conference.\n\nFrom the machine learning perspective, this work is a simple and direct application of existing machine learning tools.. \n\n\nOther comments:\nThis paper mentions the authors are from a group (Cogniscent) at IBM, which violates the double-blind policy (at least to certain degree).\n", "extra_scores": {"experience_assessment": "I have published in this field for several years.", "review_assessment:_checking_correctness_of_derivations_and_theory": "I assessed the sensibility of the derivations and theory.", "review_assessment:_checking_correctness_of_experiments": "I assessed the sensibility of the experiments.", "review_assessment:_thoroughness_in_paper_reading": "I read the paper at least twice and used my best judgement in assessing the paper."}, "extra_text": {}}, {"review_id": "BylpBu5BcS", "reviewer": "AnonReviewer1", "summary": "", "questions": "", "limitations": "", "rating": 1, "confidence": null, "soundness": null, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "This paper violates the conference's double-blind reviewing policy by explicitly identifying their research institute and team name. The violations occur in the 4th line of the abstract, the last paragraph of Section 1 (Introduction), and the first paragraph of Section 2 (System Description). For this reason, I am not providing a review of this paper.\n\n.........................................................................................................................................................................................................", "extra_scores": {"experience_assessment": "I do not know much about this area.", "review_assessment:_thoroughness_in_paper_reading": "N/A", "review_assessment:_checking_correctness_of_experiments": "N/A", "review_assessment:_checking_correctness_of_derivations_and_theory": "N/A"}, "extra_text": {}}, {"review_id": "Bkxb4isLFS", "reviewer": "AnonReviewer3", "summary": "", "questions": "", "limitations": "", "rating": 1, "confidence": null, "soundness": null, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "This work designs an electronic nose to classify beers and gets extremely high accuracy through neural network methods. \nHowever, it seems that ICLR is not a proper conference for such a work. \nThe main contribution of this work may be the electronic devices rather than the machine learning methods.\nThe author related the results of random forest but there is no related content in the main body of the paper.\n\nAt last, the paper is short of technical contents and the figures occupy a lot of the space.\n\nOverall, I am afraid that this work should find a better publication site other than ICLR.\n", "extra_scores": {"experience_assessment": "I do not know much about this area.", "review_assessment:_checking_correctness_of_derivations_and_theory": "I assessed the sensibility of the derivations and theory.", "review_assessment:_checking_correctness_of_experiments": "I carefully checked the experiments.", "review_assessment:_thoroughness_in_paper_reading": "I read the paper at least twice and used my best judgement in assessing the paper."}, "extra_text": {}}]

Author rebuttal:

Meta-review: The paper has received all negative scores. Furthermore, one of the reviewers identified an anonymity violation. This is a reject.
Decision: Reject