Data Engineer - Bitpanda Pro Job at Bitpanda Pro, London EC3M

TGUrcjdlb3hqWjZscUpuU01hTFZGdz09

Job Description

Bitpanda Pro is a leading #crypto exchange in Europe, we are highly regulated and run a spot-exchange with an ambitious and exciting product growth strategy to launch the first EU regulated derivatives exchange!

Come and help us on our journey and learn a load doing so - We look forward to your application

Your mission
As a data engineer, you focus on creating and maintaining ETL pipelines, workflows, databases and processing systems, which manifest in automation of visual reports to business stake holders. A successful candidate must be proficient in extracting intelligent data from multiple sources of raw information while actively collaborating with both application and platform engineers and the product management teams.

What you'll do

  • Design, build and operationalise business data solutions and applications using one or more of AWS data and analytics services in combination with:
    • AWS MSK, Kafka and Confluent Connect & Streams
    • AWS Glue (Schema Registry, Crawlers, Transformation jobs, Catalogs)
    • DynamoDB
    • PostgreSQL (AWS RDS Aurora)
    • Snowflake
    • AWS Kinesis, Firehose, Lambda
  • Design and build production data pipelines from ingestion to consumption within a big data architecture, using Python (knowledge of pandas, numpy, unittest, boto3).
  • Design and implement data engineering, ingestion and curation functions on AWS cloud using terraform.
  • Implement CI/CD jobs using Gitlab, to manage either the data engineering infrastructure or deploy automation jobs or code
  • Perform detail assessments of current state of ETL pipelines and Glue jobs and make appropriate changes to deliver rich reports with defined key product metrics.
  • Analyse and tune existing data marts to suit emerging business needs

Who are you

  • Experience with stream/event processing & message queues
  • Understanding operational and security concerns in AWS
  • Familiar with relevant AWS services
  • Experience in designing database architecture from ground up
  • Experience with computing and data collection/filtering algorithm
  • Programming experience with Python

Additional Information

Your key focus and expertise is:

  • AWS RDS Aurora (PostgreSQL)
  • AWS Glue
  • AWS MSK, Kafka Connect & Kafka Streams
  • AWS Kinesis, S3, Athena and Quicksight
  • Snowflake
  • Python (pandas, numpy)
  • Terraform

Benefits

  • We are flexible and support a hybrid working environment, expecting at least 3 days in the office a week
  • A competitive salary and attractive equity plan
  • Exclusive premiums when trading on Bitpanda Pro
  • Global team across London, Amsterdam, Milan, Vienna with opportunities for travel
  • Sustainable merch to keep you swagged out and living the brand

Similar Jobs

Resolve Recruitment Services

Account Executive Job at Resolve Recruitment Services

Alternatively, you could be taken on in an entirely new business position, building an account of commercial business over time.

Navartis

Quantity Surveyor Job at Navartis

Collaborate with internal teams, including quantity surveyors, to ensure accurate cost control and project profitability.

Protocol Education

High School Teacher Job at Protocol Education

You will be expected to carry out all duties of that of a permanent member of staff including marking, faculty meetings, parent meetings etc.

Jane Deane Recruitment Limited

PA/ Technical Assistant Job at Jane Deane Recruitment Limited

PA/Technical Assistant to Financial Advisor/Directors. This is a demanding role requiring strong financial services technical knowledge.Duties will include attending client meetings, doing meeting

Cambridgeshire and Peterborough NHS Foundation Trust

Business Support Job at Cambridgeshire and Peterborough NHS Foundation Trust

12-month Fixed Term Contract A rare and exciting opportunity has arisen for an enthusiastic and highly motivated individual to join the Children's