Spaces:
Runtime error
Runtime error
File size: 3,206 Bytes
3e99b05 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 |
# Practical Tools and Scripts
Apart from training and evaluation scripts, detrex also provides lots of practical tools under [tools/](https://github.com/IDEA-Research/detrex/tree/main/tools) directory or useful scripts.
## Tensorboard Log Analysis
`detrex` automatically saves tensorboard logs in `cfg.train.output_dir`, users can directly analyze the training logs using:
```bash
tensorboard --logdir /path/to/cfg.train.output_dir
```
## Model Analysis
Analysis tool for FLOPs, parameters, activations of detrex models.
- Analyze FLOPs
```bash
cd detrex
python tools/analyze_model.py --num-inputs 100 \
--tasks flop \
--config-file /path/to/config.py \
train.init_checkpoint=/path/to/model.pkl
```
- Analyze parameters
```bash
cd detrex
python tools/analyze_model.py --tasks parameter \
--config-file /path/to/config.py \
```
- Analyze activations
```bash
cd detrex
python tools/analyze_model.py --num-inputs 100 \
--tasks activation \
--config-file /path/to/config.py \
train.init_checkpoint=/path/to/model.pkl
```
- Analyze model structure
```bash
cd detrex
python tools/analyze_model.py --tasks structure \
--config-file /path/to/config.py \
```
## Visualization
Here are some useful tools for visualizing the model predictions or dataset.
### Visualize Predictions
To visualize the json instance detection/segmentation results dumped by `COCOEvaluator`, you should firstly specify the `output_dir` args for `Evaluator` in your config files, default to `None` in detrex.
```python
# your config.py
dataloader = get_config("common/data/coco_detr.py").dataloader
# dump the testing results into output_dir for visualization
# save in the same directory as training logs
dataloader.evaluator.output_dir = /path/to/dir
```
Then run the following scripts:
```bash
cd detrex
python tools/visualize_json_results.py --input /path/to/x.json \ # path to the saved testing results
--output dir/ \
--dataset coco_2017_val
```
**Note**: the visualization results will be saved in `dir/`, here's the example of the visualization for prediction results:
### Visualize Datasets
Visualize ground truth raw annotations or training data (after preprocessing/augmentations).
- Visualize raw annotations
```bash
cd detrex
python tools/visualize_data.py --config-file /path/to/config.py \
--source annotation
--output_dir dir/
[--show]
```
- Visualize training data
```bash
cd detrex
python tools/visualize_data.py --config-file /path/to/config.py \
--source dataloader
--output_dir dir/
[--show]
```
**Note**: The visualization results will be saved in `dir/`, here's the example of the visualization for annotations:
|