Category: Python Developer

joseph russell python developer summary vancouver british columbia emailemailcom experienced pyspark developer 4 years experience building scalable distributed data processing solutions proficient developing complex etl pipelines using pyspark sql nosql databases committed delivering highquality work continuously improving skills stay current new technologies work experience company name city state pyspark developer employment dates designed developed etl pipelines using pyspark hive process large datasets distributed environment collaborated data scientists business analysts understand requirements develop data models support data analysis business intelligence worked nosql databases hbase cassandra mongodb store manage large volumes data developed maintained data processing cleansing scripts using python pyspark optimized spark jobs tuning performance parameters implementing best practices partitioning caching data created maintained data pipelines using apache airflow schedule monitor manage workflows developed deployed machine learning models using pyspark libraries mllib tensorflow perform predictive analysis large datasets conducted code reviews mentored junior developers pyspark best practices leading improved code quality faster delivery times company name city state pyspark developer employment dates developed maintained pysparkbased data processing pipelines batch streaming data using kafka spark streaming spark sql designed implemented data lake architecture using aws s3 glue athena allowing flexible scalable data storage querying built deployed pysparkbased machine learning models predictive maintenance anomaly detection industrial equipment worked devops teams deploy maintain pyspark jobs apache mesos kubernetes clusters conducted technical interviews hiring candidates provided feedback pyspark skills technical knowledge skills programming apache airflow programming caching programming git big data apache kafka big data cassandra