Accessibility Links

Big Data DevOps Engineer

  • Job type: Contract
  • Location: Munich
  • Salary: Competitive
  • Job reference: JB100068
  • Sector: BI & Big Data, Cloud Software, Glocomms
  • Date posted: 09/01/2018
Senior DevOps Data Engineer -

Data-driven and consumer-centric organization are building out a big data platform which Is at the core of it's brands/data products. This platform will provide storage, big data compute, ad-hoc analytical data access, workflow pipeline management and data access services for both existing applications and new experiments. This platform is paramount in delivering deep learning techniques to derive insights that empower the organisations analytical community.

You will work closely with Agile aligned engineering teams in building out this large infrastructure platform at scale in a globally distributed and highly available cloud based system (AWS). On top of this, you will be encouraged to automate everything along the way including operational and data driven metrics collection.

Keywords
AWS (ECS), Big data, Real Time data analysis and streaming platforms (Spark Streaming, Kafka or Kinesis Streams etc), Container virtualization - Docker and Kubernetes, Unix/Linux, Jenkins, GIT, Docker, Scripting (bash or Python), monitoring, security

Key skills required:

  • AWS (ECS)
  • Building large, complex cloud-based infrastructure
  • Familiar working with data engineering/scientists and Real Time data products
  • Unix/Linux flavours (Networking, info sec)
  • Source code repositories - GIT mostly
  • Continuous Integration - Jenkins
  • Scripting - Bash or Python
  • Container Visualization - Docker, Kubernetes
  • German speaking
Nice to have:
  • Real-time analytics and streaming platforms (Spark Streaming, Kafka, Kinesis Streams, etc)
  • Machine learning pipelines in production
  • Knowledge of Distributed Systems
  • Knowledge of No SQL databases like Redis, Cassandra or DynamoDB
contact jag (at) glocomms.com or call+44 203 758 8902
Similar jobs
Senior Engineer
  • Job type: Permanent
  • Location: San Francisco
  • Salary: Competitive
  • Description My client, a highly successful health tech start-up in San Francisco with a strong leadership team, is looking to bring on a Senior Engineer to...
Data Analyst (Python/SQL)
  • Job type: Permanent
  • Location: San Francisco
  • Salary: Competitive
  • Description I'm working with one of the fastest growing tech companies in North America. They're HQ'd in San Francisco and looking to rapidly expand their Analytics...
Director of Product Management
  • Job type: Permanent
  • Location: San Francisco
  • Salary: Competitive
  • Description My client is one of the most awarded and fastest growing Bay Area fin-tech startups [specializing in payments] and is ramping up their 2018 hiring...
Embedded Developer
  • Job type: Permanent
  • Location: San Francisco
  • Salary: $150000 - $180000 per annum
  • Description An AI Series A startup based in Silicon Valley is working on an exciting new real-time software product. The team is looking for an Engineer...
Data Scientist
  • Job type: Permanent
  • Location: San Francisco
  • Salary: $140000 - $160000 per annum
  • Description I'm working with an exciting Series B startup in San Francisco. They're looking to scale up their Data Science team due to the amount of...