Keras
English
sid220 commited on
Commit
e822533
1 Parent(s): 1c8ac59

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +77 -0
README.md CHANGED
@@ -1,3 +1,80 @@
1
  ---
2
  license: mit
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ datasets:
4
+ - sid220/asl-now-fingerspelling
5
+ language:
6
+ - en
7
+ metrics:
8
+ - accuracy
9
+ library_name: keras
10
  ---
11
+
12
+ # ASLNow!
13
+ ASLNow! is a web app designed to make learning ASL fingerspelling easy and fun! You can try it live at [asl-now.vercel.app](https://asl-now.vercel.app/).
14
+
15
+ Demo: [https://www.youtube.com/watch?v=Wi5tAxVasq8](https://www.youtube.com/watch?v=Wi5tAxVasq8)
16
+ ## Model
17
+ This model, trained on the isolated fingerspelling dataset is licensed under the MIT License. It will be updated frequently as more data is collected.
18
+
19
+ ### Format
20
+ ![Overview of Model](images/plotted_model.png)
21
+
22
+ #### Input
23
+ 21 hand landmarks, each composed of `x`, `y` and `z` coordinates. The `x` and `y` coordinates are normalized
24
+ to `[0.0, 1.0]` by the
25
+ image width and height, respectively. The `z` coordinate represents the landmark depth, with the depth at the wrist
26
+ being
27
+ the origin. The smaller the value, the closer the landmark is to the camera. The magnitude of `z` uses roughly the same
28
+ scale as x.
29
+
30
+ ![Hand Landmarks](https://developers.google.com/static/mediapipe/images/solutions/hand-landmarks.png)
31
+ From: [https://developers.google.com/mediapipe/solutions/vision/hand_landmarker](https://developers.google.com/mediapipe/solutions/vision/hand_landmarker)
32
+
33
+ Example:
34
+
35
+ ```
36
+ [
37
+ # Landmark 1
38
+ [x, y, z],
39
+ # Landmark 2
40
+ [x, y, z],
41
+ ...
42
+ # Landmark 20
43
+ [x, y, z]
44
+ # Landmark 21
45
+ [x, y, z]
46
+ ]
47
+ ```
48
+
49
+ #### Output
50
+ The probability of each class, where classes are defined as such:
51
+ ```json
52
+ {
53
+ "A": 0,
54
+ "B": 1,
55
+ "C": 2,
56
+ "D": 3,
57
+ "E": 4,
58
+ "F": 5,
59
+ "G": 6,
60
+ "H": 7,
61
+ "I": 8,
62
+ "J": 9,
63
+ "K": 10,
64
+ "L": 11,
65
+ "M": 12,
66
+ "N": 13,
67
+ "O": 14,
68
+ "P": 15,
69
+ "Q": 16,
70
+ "R": 17,
71
+ "S": 18,
72
+ "T": 19,
73
+ "U": 20,
74
+ "V": 21,
75
+ "W": 22,
76
+ "X": 23,
77
+ "Y": 24,
78
+ "Z": 25
79
+ }
80
+ ```