Accessibility Links

Big Data DevOps Engineer

  • Job type: Contract
  • Location: Munich
  • Salary: Competitive
  • Job reference: JB100068
  • Sector: BI & Big Data, Cloud Software, Glocomms
  • Date posted: 09/01/2018
Senior DevOps Data Engineer -

Data-driven and consumer-centric organization are building out a big data platform which Is at the core of it's brands/data products. This platform will provide storage, big data compute, ad-hoc analytical data access, workflow pipeline management and data access services for both existing applications and new experiments. This platform is paramount in delivering deep learning techniques to derive insights that empower the organisations analytical community.

You will work closely with Agile aligned engineering teams in building out this large infrastructure platform at scale in a globally distributed and highly available cloud based system (AWS). On top of this, you will be encouraged to automate everything along the way including operational and data driven metrics collection.

Keywords
AWS (ECS), Big data, Real Time data analysis and streaming platforms (Spark Streaming, Kafka or Kinesis Streams etc), Container virtualization - Docker and Kubernetes, Unix/Linux, Jenkins, GIT, Docker, Scripting (bash or Python), monitoring, security

Key skills required:

  • AWS (ECS)
  • Building large, complex cloud-based infrastructure
  • Familiar working with data engineering/scientists and Real Time data products
  • Unix/Linux flavours (Networking, info sec)
  • Source code repositories - GIT mostly
  • Continuous Integration - Jenkins
  • Scripting - Bash or Python
  • Container Visualization - Docker, Kubernetes
  • German speaking
Nice to have:
  • Real-time analytics and streaming platforms (Spark Streaming, Kafka, Kinesis Streams, etc)
  • Machine learning pipelines in production
  • Knowledge of Distributed Systems
  • Knowledge of No SQL databases like Redis, Cassandra or DynamoDB
contact jag (at) glocomms.com or call+44 203 758 8902
Similar jobs
Senior Java Backend Engineer [Cloud]
  • Job type: Permanent
  • Location: Baltimore, Maryland
  • Salary: Negotiable
  • Description Software Engineer | Cyber Security Location: Greater Baltimore Area Compensation: Flexible DOE - Targeting between 130-160k+ with benefits, bonus, and equity Our client
Principal Data Scientist (Dutch Speaking)
  • Job type: Permanent
  • Location: Netherlands
  • Salary: car, pension, company trips
  • Description Interested in working for one of Europe's leading management consultancies that focus on technology and innovation to help develop superior strategies for their clients
Head of Big Data
  • Job type: Permanent
  • Location: Frankfurt am Main, Hessen
  • Salary: Car, Healthcare and Bonus
  • Description Senior Software Manager Glocomms is delighted to present a fantastic opportunity with a Global IT Specialist Company. My client is looking for the most creative and experienced engineering leaders
Data Scientist (behavioural/digital marketing)
  • Job type: Permanent
  • Location: London
  • Salary: Competitive
  • Description Two years' industry experience, ideally in a (digital) Marketing field, experience with behavioural data sources is essential. Proficient in Python, Tensorflow, SQL and Spark
CDO
  • Job type: Permanent
  • Location: München (81249), Bayern
  • Salary: Negotiable
  • Description One of the leading companies in Munich is looking for: Role: CDO Company: Automotive Sector Location: Munich Task: Work with executives, data owners, and data stewards to achieve data accuracy and