Update README.md

README.md

@@ -8,7 +8,7 @@ However, the widespread adoption of ReLU-based models in the LLM field remains l
 
 ## Model Architecture
 
-To push the model's sparsity, we add a ReLU component after GLU component, called dReLU(double ReLU) So our FFN network works as follows:
+To push the model's sparsity, we add a ReLU component after GLU component, called dReLU(double ReLU). So our FFN network works as follows:
 
 ```Python
 class BambooMLP(nn.Module):