Data Engineer

Requirements:

• designing scalable and flexible data architecture, creating data catalogue, data maps and data flow maps in the enterprise environment
• performing data modelling tasks, building and running models
• performing data analysis tasks, using descriptive statistical tools, filtering, cleaning, transforming and displaying available data
• contributing to the optimisation of data stored in a hybrid environment.
• designing simple integration of new data assets
• assessing and developing standards and best practices for building new data services.
• identifying and developing use cases.
• liaising with data integration stakeholders, business partners and service providers
• knowledge of data integration methodologies, tools and frameworks
• knowledge of hybrid environment, knowledge of AWS environment.
• hands-on experience in any data visualisation tool such as PowerBI, SAC, Tableau
• building and maintaining systems used to process and manage large volumes of data
• collecting, analysing and organising raw data into systems
• building and maintaining systems for data collection, processing, analysis, reporting and presentation
• interpreting business needs and objectives
• identifying and interpreting data patterns and relationships
• collaborating with data science co-disciplines

Responsibilities:

• 3+ years relevant experience in a similar position
• experience in data technologies. hadoop, spark and friends
• knowledge of technologies expected on the project: AWS, databricks, google bigquery, oracle
• advanced knowledge of java and/or python languages
• analytical and mathematical skills (linear algebra, statistics, probability)

An advantage would be:

• relevant technical diploma
• production data engineer qualification