Package: fastds
akafdsfdsis a tool for Data Scientists made byDAGsHubto version control data and code at once.At a high level,fdsis a command line wrapper around Git andDVC, meant to minimize the chances of human error, automate repetitive tasks, and provide a smoother landing for new users.See the launch blogfor more information about the motivation behind this project.InstallationInstallfdsusing PIPpip3 install fastdsOnce installed successfully, you can start usingfdseg:fds initshould trigger the init commandYou can also usesdfinstead offds- it's identical, but might be more fun to type 🤓Commands Supported$ fds -h
usage: fds [-h] [-v] {init,status,add,commit,push,save} ...

One command for all your git and dvc needs

positional arguments:
  {init,status,add,commit,push,save}
                        command (refer commands section in documentation)
    init                initialize a git and dvc repository
    status              get status of your git and dvc repository
    add                 add files/folders to git and dvc repository
    commit              commits added changes to git and dvc repository
    clone               Clones from git repository and pulls from dvc remote
    push                push commits to remote git and dvc repository
    save                saves all project files to a new version and pushes
                        them to your remoteExamplesfds status=dvc status+git statusfds statuslets us quickly check the full status of the repo - both DVC and git at the same time, to make sure we don't forget anything.Here, we can see that we have a small, normal text file -.gitignore, plus abigfile.txtanddatafolder which we would want to add to DVC and not to git.fdsadd makes that easy!fds add=dvc add+git addwizard 🧙‍♂️You're probably used to the convenience of usinggit add .to just track everything. Unfortunately, you have to be careful doing this when working with large files - one wrong move, and you might fry your hard drive by accidentally telling git to track a huge dataset!We wanted to retain the convenience of just typing one command which means "just track all changes, I'll do agit commitin one second", which will be smart enough to avoid the pitfalls of large data files.fds adddoes exactly that, while interactively asking the user how to handle files. You can add to DVC, or git, recursively step into large folders, skip or ignore files, etc.Here's the file tree of the repo I used above, with file sizes included. Note howbigfile.txtanddata/were automatically added to DVC and not git:fds commit=dvc commit+git commitFinally, to close the loop of a real workflow, what happens when I change existing DVC tracked files? Without FDS, you'd have to remember to separately rundvc reproordvc commit, thengit add tracked_file.dvc, and only thengit commit.fds commitdoes all that for you - commits changes to DVC first, then adds the.dvcfiles with the updated hashes to git, then immediately commits these changes (plus any other staged changes) to a new git commit. Voila!Important note on using FDS inside Jupyter notebooks and Google ColabFDS is designed for interactive use via prompts that require user input.While this is possible to do inside Jupyter notebooks,it won't worh with the%%bashmagic.You have to use!fdssince%%bashprevents user input.See Colab example hereContributingWe would love for you to try out FDS yourself, and to give us feedback. It would really help us to prioritize future features, so pleasevote on or create issues!If you'd like to take a more active part, we have somegood first issuesthat you can start with. We'll be happy to provide guidance on the best way to do so.And of course, we're always happy to have you on the DAGsHub discord, where you can ask questions or give feedback on FDS:Made with ❤️   by