File size: 513 Bytes
5200e91 2f17940 5200e91 2f17940 5200e91 2f17940 5200e91 2f17940 |
1 2 3 4 5 6 7 8 9 10 11 |
---
license: cc-by-nc-2.0
---
An experimentation regarding 'lasering' each expert to denoise and enhance model capabilities.
This follows the implementation of laserRMT @ https://github.com/cognitivecomputations/laserRMT
Here, we are controlling layers checking which ones have lower signal to noise ratios (which are more subject to noise), to apply Laser interventions, still using Machenko Pastur to calculate this ratio.
We are looking forward to measure its evaluation over the most important benchmarks. |