Data Engineer - Bitpanda Pro Job at Bitpanda Pro, London EC3M

TGUrcjdlb3hqWjZscUpuU01hTFZGdz09

Job Description

Bitpanda Pro is a leading #crypto exchange in Europe, we are highly regulated and run a spot-exchange with an ambitious and exciting product growth strategy to launch the first EU regulated derivatives exchange!

Come and help us on our journey and learn a load doing so - We look forward to your application

Your mission
As a data engineer, you focus on creating and maintaining ETL pipelines, workflows, databases and processing systems, which manifest in automation of visual reports to business stake holders. A successful candidate must be proficient in extracting intelligent data from multiple sources of raw information while actively collaborating with both application and platform engineers and the product management teams.

What you'll do

  • Design, build and operationalise business data solutions and applications using one or more of AWS data and analytics services in combination with:
    • AWS MSK, Kafka and Confluent Connect & Streams
    • AWS Glue (Schema Registry, Crawlers, Transformation jobs, Catalogs)
    • DynamoDB
    • PostgreSQL (AWS RDS Aurora)
    • Snowflake
    • AWS Kinesis, Firehose, Lambda
  • Design and build production data pipelines from ingestion to consumption within a big data architecture, using Python (knowledge of pandas, numpy, unittest, boto3).
  • Design and implement data engineering, ingestion and curation functions on AWS cloud using terraform.
  • Implement CI/CD jobs using Gitlab, to manage either the data engineering infrastructure or deploy automation jobs or code
  • Perform detail assessments of current state of ETL pipelines and Glue jobs and make appropriate changes to deliver rich reports with defined key product metrics.
  • Analyse and tune existing data marts to suit emerging business needs

Who are you

  • Experience with stream/event processing & message queues
  • Understanding operational and security concerns in AWS
  • Familiar with relevant AWS services
  • Experience in designing database architecture from ground up
  • Experience with computing and data collection/filtering algorithm
  • Programming experience with Python

Additional Information

Your key focus and expertise is:

  • AWS RDS Aurora (PostgreSQL)
  • AWS Glue
  • AWS MSK, Kafka Connect & Kafka Streams
  • AWS Kinesis, S3, Athena and Quicksight
  • Snowflake
  • Python (pandas, numpy)
  • Terraform

Benefits

  • We are flexible and support a hybrid working environment, expecting at least 3 days in the office a week
  • A competitive salary and attractive equity plan
  • Exclusive premiums when trading on Bitpanda Pro
  • Global team across London, Amsterdam, Milan, Vienna with opportunities for travel
  • Sustainable merch to keep you swagged out and living the brand

Similar Jobs

Edmund and Evans

Senior Recruitment Consultant Job at Edmund and Evans

Recruitment Consultant/Senior Recruitment Consultant - Birmingham- Basic up to 35,000 DOE - 50,000 OTE year 1, 70,000 OTE year 2, 100,000+ OTE year 3 +

Protocol Education

High School Teacher Job at Protocol Education

You will be expected to carry out all duties of that of a permanent member of staff including marking, faculty meetings, parent meetings etc.

Lead Careers

Landscape Architect Job at Lead Careers

A Landscape Architecture degree and a MSc in Landscape Architecture is beneficial. Some experience in the design and detailing of hard and soft landscaping

Navartis

Fitter Job at Navartis

Due to growth in workload, they are looking for Mechanical Fitters with a heavy engineering background, preferably within rail or a similar heavy manufacturing

mydentist

Dental Nurse Job at mydentist

We are currently looking for an experienced trainee dental nurse to join ur busy practice in Rhyl. Excellent public transport links and parking, located outside