Hugging Face's logo

Spaces:
KedirAhmed
/
Topic-modeling-and-NER
No application file

App Files Community
KedirAhmed commited on
Commit
21b78eb
·
1 Parent(s): e7df026

Add Application files

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +5 -0
  2. LICENSE +21 -0
  3. app/client/__pycache__/examples.cpython-38.pyc +0 -0
  4. app/client/__pycache__/ner_examples.cpython-38.pyc +0 -0
  5. app/client/requirement.txt +7 -0
  6. data/GLG_test_data.csv +3 -0
  7. data/GLG_test_data_emb.csv +3 -0
  8. data/GLG_train_data.csv +3 -0
  9. data/GLG_train_data_emb.csv +3 -0
  10. data/GLG_train_data_labeled.csv +3 -0
  11. data/data_tech_health.csv +3 -0
  12. data/hierarchial_cluster.csv +3 -0
  13. data/ner.csv +3 -0
  14. doc/frontend_main.png +0 -0
  15. doc/frontend_ner.png +0 -0
  16. doc/frontend_topic.png +0 -0
  17. doc/image.md +1 -0
  18. doc/ner_example.png +0 -0
  19. doc/topic_modeling_pipeline.png +0 -0
  20. docker-compose.yml +26 -0
  21. models/nermodels/model.pt +3 -0
  22. models/topicmodels/mdl_topic_model_global_-1.bin +3 -0
  23. models/topicmodels/mdl_topic_model_global_0.bin +3 -0
  24. models/topicmodels/mdl_topic_model_global_1.bin +3 -0
  25. models/topicmodels/mdl_topic_model_global_10.bin +3 -0
  26. models/topicmodels/mdl_topic_model_global_11.bin +3 -0
  27. models/topicmodels/mdl_topic_model_global_12.bin +3 -0
  28. models/topicmodels/mdl_topic_model_global_13.bin +3 -0
  29. models/topicmodels/mdl_topic_model_global_14.bin +3 -0
  30. models/topicmodels/mdl_topic_model_global_15.bin +3 -0
  31. models/topicmodels/mdl_topic_model_global_16.bin +3 -0
  32. models/topicmodels/mdl_topic_model_global_17.bin +3 -0
  33. models/topicmodels/mdl_topic_model_global_18.bin +3 -0
  34. models/topicmodels/mdl_topic_model_global_19.bin +3 -0
  35. models/topicmodels/mdl_topic_model_global_2.bin +3 -0
  36. models/topicmodels/mdl_topic_model_global_20.bin +3 -0
  37. models/topicmodels/mdl_topic_model_global_21.bin +3 -0
  38. models/topicmodels/mdl_topic_model_global_22.bin +3 -0
  39. models/topicmodels/mdl_topic_model_global_3.bin +3 -0
  40. models/topicmodels/mdl_topic_model_global_4.bin +3 -0
  41. models/topicmodels/mdl_topic_model_global_5.bin +3 -0
  42. models/topicmodels/mdl_topic_model_global_6.bin +3 -0
  43. models/topicmodels/mdl_topic_model_global_7.bin +3 -0
  44. models/topicmodels/mdl_topic_model_global_8.bin +3 -0
  45. models/topicmodels/mdl_topic_model_global_9.bin +3 -0
  46. models/topicmodels/mdl_topic_model_local_-1.bin +3 -0
  47. models/topicmodels/mdl_topic_model_local_0.bin +3 -0
  48. models/topicmodels/mdl_topic_model_local_1.bin +3 -0
  49. models/topicmodels/mdl_topic_model_local_10.bin +3 -0
  50. models/topicmodels/mdl_topic_model_local_11.bin +3 -0
.gitattributes CHANGED
@@ -1,3 +1,8 @@
 
 
 
 
 
1
  *.7z filter=lfs diff=lfs merge=lfs -text
2
  *.arrow filter=lfs diff=lfs merge=lfs -text
3
  *.bin filter=lfs diff=lfs merge=lfs -text
 
1
+ *.bin filter=lfs diff=lfs merge=lfs -text
2
+ *.sav filter=lfs diff=lfs merge=lfs -text
3
+ *.csv filter=lfs diff=lfs merge=lfs -text
4
+ *.savgit filter=lfs diff=lfs merge=lfs -text
5
+ *.pt filter=lfs diff=lfs merge=lfs -text
6
  *.7z filter=lfs diff=lfs merge=lfs -text
7
  *.arrow filter=lfs diff=lfs merge=lfs -text
8
  *.bin filter=lfs diff=lfs merge=lfs -text
LICENSE ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ MIT License
2
+
3
+ Copyright (c) 2022 kedir
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining a copy
6
+ of this software and associated documentation files (the "Software"), to deal
7
+ in the Software without restriction, including without limitation the rights
8
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
+ copies of the Software, and to permit persons to whom the Software is
10
+ furnished to do so, subject to the following conditions:
11
+
12
+ The above copyright notice and this permission notice shall be included in all
13
+ copies or substantial portions of the Software.
14
+
15
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21
+ SOFTWARE.
app/client/__pycache__/examples.cpython-38.pyc ADDED
Binary file (2.51 kB). View file
 
app/client/__pycache__/ner_examples.cpython-38.pyc ADDED
Binary file (458 Bytes). View file
 
app/client/requirement.txt ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ streamlit
2
+ pandas
3
+ numpy
4
+ PyPDF2
5
+ st-annotated-text
6
+ wordcloud
7
+ Pillow
data/GLG_test_data.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52c4df02c02fc73d5691675e9f0b7ab4131a094e8bedbab520be05eeb58e2b2b
3
+ size 3286384
data/GLG_test_data_emb.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1eb13d16f0bef7bf79c642cb70d2ec94a1de5276f6e15439b379247ec11f5819
3
+ size 54050
data/GLG_train_data.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a3ec3f54c34ace7f910a0027f39b78734c0a4ee0b47aa2f5070be035800ce84
3
+ size 29353688
data/GLG_train_data_emb.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4669badf749f670e60c199b1382be98d7e58e300d9017113cdb0973d3088b26
3
+ size 485927
data/GLG_train_data_labeled.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba3aa1336597969beb5c45e0f3904f53c6245f0d2963374ebabb2392af03ccfb
3
+ size 29379406
data/data_tech_health.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4a42ac33656056d5e1aede3216abdca4bfed591e13c2daf285c4dc2cefba4e6
3
+ size 32639981
data/hierarchial_cluster.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f06d1a66d7f4373e2b3c6a823202dfd608acbeba87e28f439d73f73f1e7757f6
3
+ size 326670
data/ner.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5a0016023ba71542431bfec2e90c2e1cad7d9071eadcdd8782c8dcf45ea98df1
3
+ size 157030359
doc/frontend_main.png ADDED
doc/frontend_ner.png ADDED
doc/frontend_topic.png ADDED
doc/image.md ADDED
@@ -0,0 +1 @@
 
 
1
+ List of images used in README
doc/ner_example.png ADDED
doc/topic_modeling_pipeline.png ADDED
docker-compose.yml ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ version: "3.7"
2
+ services:
3
+ backendtopic:
4
+ build: src_topic
5
+ ports:
6
+ - "8000:8000"
7
+ networks:
8
+ - AIservice
9
+
10
+ backendner:
11
+ build: src_ner
12
+ ports:
13
+ - "9000:9000"
14
+ networks:
15
+ - AIservice
16
+
17
+ frontend:
18
+ build: ui-frontend
19
+ ports:
20
+ - "8501:8501"
21
+ networks:
22
+ - AIservice
23
+
24
+ networks:
25
+ AIservice:
26
+ external: true
models/nermodels/model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1db187faad0c0dd6e7d35663fe1bf4071b08e5fcbdf298126641dd5e3d6f952b
3
+ size 433397295
models/topicmodels/mdl_topic_model_global_-1.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5993ccbc76556a0cbb8c08394b886ff0a5ae72091f38cf8b5099441adf24153d
3
+ size 204639
models/topicmodels/mdl_topic_model_global_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:627e65da67fe062c41df17e2784ab85cead1a4b466b92c6037ef02bc351c6546
3
+ size 204639
models/topicmodels/mdl_topic_model_global_1.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ddb3181de2990396a37b4bf34587d8e626979af6ed9a0d6bf8cf364111a763bc
3
+ size 1016311
models/topicmodels/mdl_topic_model_global_10.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ea7f4eca39344e28632efb40123bc53ece2d8620f89fefae09af294c1a4df16
3
+ size 62054
models/topicmodels/mdl_topic_model_global_11.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b21aabafbca40868adf43bc5c5ee6ab0a8fc9f4afbeeebcd6bf9277a609988f
3
+ size 62054
models/topicmodels/mdl_topic_model_global_12.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12bd5e96995e4f26679480d1dce7bc58c4858f85f7907c1efc2417b8fd7710b2
3
+ size 330222
models/topicmodels/mdl_topic_model_global_13.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4ed010c6e5f1cfcccdbcff1c466a3208c62f8a165583939019e93014d046506
3
+ size 330224
models/topicmodels/mdl_topic_model_global_14.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:81879ac8035b921bae4968c02ee5b754613e5601111a72b65f8a83d32ae19d54
3
+ size 71763
models/topicmodels/mdl_topic_model_global_15.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0ad10d496c029727dcbe5652692718197bcadec82ae1cb8e79b98e11b79a627
3
+ size 9001
models/topicmodels/mdl_topic_model_global_16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3acc86676ff2d30b71a70f885734de53647f0478df0d199c63034bc0dd40c46d
3
+ size 22810
models/topicmodels/mdl_topic_model_global_17.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c9eb68e96efc32d42898e58c864a69b9ba7638bbd776a4cb1186769dc07ad63b
3
+ size 1040089
models/topicmodels/mdl_topic_model_global_18.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5648d04e9e6705256b2ec581afb5c16541cf4824e3237819502a6f06f1e5998b
3
+ size 1032674
models/topicmodels/mdl_topic_model_global_19.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1c123ced85f1dc50dfb8fb65f2cd860cef2894a9f9614e55a0421abf98a8113
3
+ size 87692
models/topicmodels/mdl_topic_model_global_2.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6afdac1aee771038cdcb581c542d9b9389daa5b2b58105e4df39b7a2a768cf65
3
+ size 286107
models/topicmodels/mdl_topic_model_global_20.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6832d9cb0b838680f5ac82da144fdd8a887f244dac30e94b000951ff7c6ab17e
3
+ size 691600
models/topicmodels/mdl_topic_model_global_21.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2c03cb254275658e3d1e399a40bfd290dc280ca6d324b644303ede6a1268e6f
3
+ size 386978
models/topicmodels/mdl_topic_model_global_22.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d91804cbff80beeb27936477531de15c8d303b2b50e9b77b66d876466fa9100
3
+ size 2242937
models/topicmodels/mdl_topic_model_global_3.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:533177cbd23bd33a271890c09bb114737830ff603bd864d4304933546c8c8f28
3
+ size 6693
models/topicmodels/mdl_topic_model_global_4.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a1a20d70ae0d4d9ce3d1473aa53930d6f3f5c2a8f4dd2f75cbb73f6bd3a620d5
3
+ size 885
models/topicmodels/mdl_topic_model_global_5.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2ca53907d41bb936b7ad7ff1d304ddd2f628e283fb2954dfe93cbf1d595a1f9
3
+ size 232539
models/topicmodels/mdl_topic_model_global_6.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e50ece23ca797d682ecca9a84b08f0cab23bed505df65662fb508bdb6a8f539
3
+ size 18182
models/topicmodels/mdl_topic_model_global_7.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52ef1e6e5e7cd7a046f05eef9ea9e15a8f2719079929558fb3141f8e7d9c7d3d
3
+ size 18182
models/topicmodels/mdl_topic_model_global_8.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9240784cc4f15d21812f25868db18d8df436c21eea8d6a4e4ded19a3418226f4
3
+ size 206473
models/topicmodels/mdl_topic_model_global_9.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:65c8f1bf1b5dbf19ba829eb4fd5441192212de56733aed482ddd45a6d8e22a75
3
+ size 314923
models/topicmodels/mdl_topic_model_local_-1.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1bd30ddba6458c56ec62729d897450b0bcea94b994a63b8204997dedf0383984
3
+ size 4625635
models/topicmodels/mdl_topic_model_local_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5b14b12624eabf92060f07632c1ffdccbed7025fbd9d0c3479e05dc4dc9f069
3
+ size 541159
models/topicmodels/mdl_topic_model_local_1.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc500c9c5364a359898f2e54ff1d763bbc9b9c8be59c99af10b6b25623105da8
3
+ size 2996229
models/topicmodels/mdl_topic_model_local_10.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b5a3592dc874e76e31e41478d4effbc563190dbefe8d94c24c832f66dd8e093
3
+ size 655701
models/topicmodels/mdl_topic_model_local_11.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4eca7b2d803645e60aa2e52f3f75d2741b0de5d57cbea3429c289d668ea246d4
3
+ size 1239019