Package: lognub
LogNubLoguru utility packageTODOMove logwrap [on top of loguru] extension out as a seperate package.Add Test containers foramundsen, etc..Getting StartedSetupSDKMANSetupJavaSetupApache SparkInstallPoetryInstall Pre-commit andfollow instruction in hereRuntests locallySetup SDKMANSDKMAN is a tool for managing parallel Versions of multiple Software Development Kits on any Unix based
system. It provides a convenient command line interface for installing, switching, removing and listing
Candidates. SDKMAN! installs smoothly on Mac OSX, Linux, WSL, Cygwin, etc... Support Bash and ZSH shells. See
documentation on theSDKMAN! website.Open your favourite terminal and enter the following:$curl-shttps://get.sdkman.io|bash
IftheenvironmentneedstweakingforSDKMANtobeinstalled,
theinstallerwillpromptyouaccordinglyandaskyoutorestart.

Next,openanewterminalorenter:

$source"$HOME/.sdkman/bin/sdkman-init.sh"Lastly,runthefollowingcodesnippettoensurethatinstallationsucceeded:

$sdkversionSetup JavaInstall Java Now open favourite terminal and enter the following:ListtheAdoptOpenJDKOpenJDKversions
$sdklistjava

InstalltheJava8:
$sdkinstalljava8.0.292.hs-adpt

SetJava8asdefaultJavaVersion:
$sdkdefaultjava8.0.292.hs-adpt

ORToinstallForJava11$sdkinstalljava11.0.10.hs-adptSetup Apache SparkInstall Java Now open favourite terminal and enter the following:ListtheApacheSparkversions:
$sdklistspark

ToinstallForSpark3$sdkinstallspark3.0.2

ToinstallForSpark3.1
$sdkinstallspark3.0.2Install PyEnv and Python 3.8Either install pyenv via brew or github:brewinstallpyenv

Thensetupinzshrc:echo'eval "$(pyenv init --path)"'>>~/.zprofileecho'eval "$(pyenv init -)"'>>~/.zshrcThen Install Python 3.8:pyenvinstall3.8.11cd allocator project directory:# Checkout git repo of iAllocatorcddse-iAllocatorcdcustomer/allocator# Now set default python version as 3.8.11pyenvlocal3.8.11# Verify python versionpython-V
Python3.8.11Create VirtualENVCreate local venv inside allocator project:cddse-iAllocator[Repodirectory]cdcustomer/allocator# Create virtualenv locallypython-mvenv.venv# Verify activate file existsls-G.venv/bin# Activate virtual env pythonsource.venv/bin/activateVerify virtual env and python is working and .venv is activated:whichpython# should end with {$ROOT_DIR}.venv/bin/pythonwhichpip# should end with {$ROOT_DIR}.venv/bin/pipPoetryPoetryCommands- Python package management toolInstall Poetry:Install poetry using brewbrewinstallpoetryORFollow instructions for Linux:here# For osx / linux / bash on windows install:curl-sSLhttps://raw.githubusercontent.com/python-poetry/poetry/master/get-poetry.py|python-Install the dep packages:NOTE: Make sure you are connected to OpenVPN[since some are internal packages - catalog_client]Installpsycopg2binaryviaPIP:
$pipinstallpsycopg2-binary==2.9.1

InstallrestofpackagesviaPoetry:

$poetryinstall# --tree: List the dependencies as a tree.# --latest (-l): Show the latest version.# --outdated (-o): Show the latest version but only for packages that are outdated.poetryshow-o

Toupdateanypackage:#$ poetry update pandasRunning Tests LocallyTake a look at tests intests/dataqualityandtests/jobs$poetryrunpytest
Ran95testsin96.95sThats it, ENV is setupNOTE: Loguru Wrap Package extracted from different internal package
NOTE: It's just curated stuff, Created for personal usage.