Position: Python Data Engineer
Company: IdeaSoft
Category: Python
Experience required: 3y
English level: intermediate

REQUIREMENTS:
• 4+ years of experience Python 
• Experience with Python architecture, Data flow architecture, Concurrency,  Serialization, Memoization, Performance Optimization
• 2+ years of experience using distributed ecosystems.
• Experience with Hadoop, Kafka, Hbase, Hive
• Knowledge of relational databases and non-relational databases and querylanguages (SQL).
• Working experience with Linux OS (CentOS/Ubuntu).
• Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
• Dynamic, agile, and comfortable with the whole data stack. Capable of adjusting quickly to changing requirements, and can deliver rapid and correct solutions.
• Able to communicate the results of analyses in a clear and effective manner.
• English - Intermediate 

WILL BE Advantage:
• Pyspark, Scala, NodeJS 
• Experience with the Ad-tech or E-commerce world 

RESPONSIBILITIES:
• Responsible for expanding and optimizing our data and future data pipeline architecture, as well as optimizing data flows and collections for cross-functional teams. 
• Provide monitoring, management, troubleshooting, and issue resolution to existing and new data solutions and systems’ interfaces affected by them.
• Develop high quality, reliable, and fault-tolerant data solutions based on internal and external customers/users’ requirements, applying best practices and new trends/technologies all along the solution lifecycle.
• Dig into the latest big data technologies to develop distributed, high-throughput, real-time products.