Position: DevOps for banking project
Company: Intellias
Category: DevOps
Experience required: 2y
English level: intermediate
Published: 2021-06-01T00:00:00+03:00

Implementation of Data Platform solution for Retail Bank within the following capabilities:

Core Data Platform
Onboarded Data Producer/Consumer Applications, Configuration & Customisations
Onboarding & Management of Data Producer/Consumer Applications
Application, Data Source, Job, Job Data, Job Steps, and Data Access Taxonomies
Standardized Push/Pull Streaming/Batch Ingestion Interfaces
Polyglot Data-lake Storage (e.g., Bucket, KV, NoSQL, Search, Warehouse, SQL, etc.)
Customizable Ingestion Conformance-tier/Stage/Archive Processors
Customizable Ingestion Optimised Format (e.g., Parquet/ORC) Processors
Customizable Transformation/Enrichment Processors
Customizable Microservices & API Processors
Standardized Query API (e.g., J/ODBC) Data Access Interfaces
Standardized Export API, Bucket Endpoint & Notify Data Access Interfaces
Standardized Streaming Egress Data Access Interface
RBAC (Role-Based Access Controls)
TLS (in-flight) & TDE (at-rest) Encryption capabilities
Operational Metrics & Monitoring capabilities
Data Platform Resource Utilisation Tracking & Cost Allocation capabilities
DLM, Archive, Retention capabilities
Schema Registry capabilities etc.

**Responsibilities:**

design and development of data processing pipelines for ML solutions;
building cloud native deliveries for on-premise Kubernetes cluster or AWS deployment;
interacting with stakeholders for requirements elicitation;
research and prototyping of promising tools/approaches/practices with further implementation;
managing knowledge base / technical documentation for developed solutions;
participating in Enterprise Data Platform design and development;
Deep co-operation with Product Teams (POs, analysts, architectors, devs, testers, IT-deliverers, etc.);
SW Architecture design & maintenance;
Release, Delivery, Change Mgmt, Support, Incident mgmt &  Troubleshooting:
Planning & control. Improvement & development              
Technical requirements & specifications preparation & approval
API/ specifications development, maintenance & approval             
Ensuring quality testing (QAT, integration)
Providing quality & on-time SW delivery (installation & configuration)  & support

**Requirements:**

2+ years of experience as a DevOps Engineer
experience in Data Engineering / DB Development / ETL-ELT Development (2+ years)
expert knowledge of Python, SQL, PL/SQL
good knowledge of RDBMS (Oracle, PostgreSQL, SAP IQ)
experience in Big Data stack (Hadoop, HBase, Kafka, Spark, Nifi, Superset)
experience in AWS (EC2, S3, EBS, EKS, Lambda, Athena, SNS/SQS)
experience in Kubernetes, Docker, Linux, UNIX
experience in Git (GitLab), Bitbucket, Ansible, Bash, Nexus
experience in maintaining and executing build scripts to automate development and production builds
practical experience in IT systems building & support;
automation of: installation & maintenance routines, troubleshooting, incident mgmt (logs; monitoring KPIs, triggers & alerts);
analyzing the needs and proposals of business units in order to improve the services;
control and enforcement of services on-time implementation & delivery
experience in Network Protocols*:*SMTP, SNMP, ICMP, TCP/IP, FTP, TELNET, NIS, LDAP, UDP
good communication skills (English intermediate+) – verbal and written
bug Tracking System: Jira
Confluence

**Nice to have:**

experience in Apache NiFi, Pulsar, Groovy
knowledge of Jenkins and CI/CD principles, experience in pipelines development
knowledge and experience in Data Science / Machine Learning
experience with processing of large amount of data
analytics and design skills
experience of working in an Agile team and environment