Big Data System Engineer

Vor 4 Tagen

Zürich, Zürich, Schweiz Wavestone Germany AG Vollzeit

For an exciting project with our client in Zurich (remote work only possible within Switzerland), we are looking for a Big Data System Engineer / Platform Engineer (m/f/d).

Key Facts

Start: 02.05.2025

Duration: 6 months / + Verlängerungsoption

Capacity: 100 %

Employment type: Personal leasing

Job site: Zürich

Job country: Schweiz

Your tasks

• You are operating Global Data Platform components (VM Servers, Kubernetes, Kafka) and applications (Apache stack, Collibra, Dataiku and similar)

• Implement automation of infrastructure, security components, and Continuous Integration & Continuous Delivery for optimal execution of data pipelines (ELT/ETL)

• Develop solutions to build resiliency in data pipelines with platform health checks, monitoring, and alerting mechanisms, quality, timeliness, recency, and accuracy of data delivery are improved

• Apply DevSecOps & Agile approaches to deliver the holistic and integrated solution in iterative increments

• Liaison and collaborate with enterprise security, digital engineering, and cloud operations to gain consensus on architecture solution frameworks

• Review system issues, incidents, and alerts to identify root causes and continuously implement features to improve platform performance

• Stay up to date with the latest industry developments and technology trends to successfully lead and design new features and capabilities

Must have competences

• 5+ years of experience in building or designing large-scale, fault-tolerant, distributed systems

• Experience with physical Disaster Recovery testing in large data platforms on premise, with upstream and downstream pipelines

• Experience of agile project management and methods e.g., Scrum, SAFe)

• In-depth knowledge of all analytical value streams from enterprise reporting (e.g. Tableau) to data science (incl. ML Ops)

• Fluent in English, good knowledge of German is beneficial

• Hands-on working knowledge of large data solutions (for example: data lakes, delta lakes, data meshes, data lakehouses, data platforms, data streaming solutions…)

• In-depth knowledge and experience in one or more large scale distributed technologies including but not limited to: Hadoop ecosystem, Kafka, Kubernetes and Spark

• Expert in Python and Java or another static language like Scala/R, Linux/Unix scripting, Jinja templates and puppet scripts, firewall config rules setup

• Expertise in VM setup and scaling (pods), K8S scaling, managing Docker with Harbor, pushing Images through CI/CD

• Experience in integration of streaming and file based data ingestion / consumption (Kafka, Control M, AWA)

• Well-versed in DevOps, data pipeline development and automation using Jenkins and Octopus (optional: Ansible, Chef, XL Release, and XL Deploy)

• Experience predominately with on-prem Big Data architecture, cloud migration experience might come handy

• Hands-on experience in integrating Data Science Workbench platforms (e.g. Dataiku)

Nice to have competences

• Higher education e.g. "Fachhochschule","Wirtschaftsinformatik")

• Exposure to data formats such as Apache Parquet, ORC, or Avro Experience in machine learning algorithms is a plus

Let's power the future together

From Business Case to Implementation: As a leading consulting firm for strategic transformations, we are a trusted partner for our clients—and for our employees. Responsible, high-performing, and always with a focus on people. #WeAreWavestone

With our 360° portfolio of consulting services, we combine top-tier industry expertise with a wide range of cross-sector skills, work interdisciplinary, and think outside the box. This allows us to offer our partner companies and freelancers comprehensive perspectives within our own projects, while also supporting them as a long-standing framework agreement partner in filling project vacancies—promptly and directly.

We look forward to hearing from you

Your direct contact at Wavestone

Vivek Kandiah

Phone: +41 76 223 85 15

E-Mail: vivek.kandiah@wavestone.eu

  • Big Data/Pyspark Engineer

    Vor 3 Tagen

    Zürich, Zürich, Schweiz AMMGroup Vollzeit

    Job Title: Big Data/Pyspark EngineerLocation : Zurich, SwitzerlandJob Description:10+ years of IT experience with in-depth big data technologyConceptualize and design big data system involving Hadoop, PySpark, Hive.Extensively worked on Python and pyspark ProgrammingExperience in building complex data pipelines using Spark and especially PySpark Experience...

  • Big Data System Engineer

    vor 1 Tag

    Zürich, Zürich, Schweiz Experis Switzerland Vollzeit

    Experis is the global leader in professional resourcing and project-based workforce solutions.Overview of contractOn behalf of our client, a large bank in Switzerland, we are looking for a Big Data System Engineer (Platform Engineer).Location: ZurichStart date: NegotiableDuration: 12 months – with possibility of extension/ internalizationKey...

  • Architekt von Big Data-Lösungen

    Vor 7 Tagen

    Zürich, Zürich, Schweiz ELCA Group Vollzeit

    ELCA Group bietet Ihnen die Möglichkeit, Teil eines jungen und innovativen Teams zu sein, das darauf abzielt, innovative Technologieplattformen bereitzustellen, die das Wachstum unserer Kunden fördern.Wir suchen einen Senior Big Data Engineer mit Erfahrung in der Implementierung von komplexen verteilten Datenplatformen und Anwendungen, um große...

  • Big Data System Engineer

    Vor 4 Tagen

    Zürich, Zürich, Schweiz Wavestone Germany AG Vollzeit

    For an exciting project with our client in Zurich (remote work only possible within Switzerland), we are looking for a Big Data System Engineer / Platform Engineer (m/f/d). Key FactsStart: 02.05.2025Duration: 6 months / + VerlängerungsoptionCapacity: 100 %Employment type: Personal leasingJob site: ZürichJob country: SchweizYour tasks• You are operating...

  • Big Data Analytics Engineer

    vor 4 Wochen

    Zürich, Zürich, Schweiz ONE Agency | IT Recruitment Experts Vollzeit

    ONE Agency | IT Recruitment ExpertsBig Data Analytics EngineerÜber unseren KundenUnser Kunde ist ein IT UnternehmenIhr Aufgabenbereich- Unser Kunde befindet sich im Wachstum, welches sie aktiv mitgestalten können.- Sie werden zusammen im Team und deren Kunden einen wertvollen Beitrag im Bereich Softwaredesign und -implementierung für vielfältigen...

  • Big Data Engineer

    Vor 7 Tagen

    Zürich, Zürich, Schweiz Adnovum Vietnam Vollzeit

    We are seeking an exceptional Data Engineer to join our dynamic team in Adnovum Vietnam. As a key member of our team, you will be responsible for designing, developing, and maintaining scalable data management systems that drive business innovation and decision-making.ResponsibilitiesDesign and build scalable data pipelines and management systems to support...

  • Senior Big Data System Architect with Kubernetes Expertise

    Vor 4 Tagen

    Zürich, Zürich, Schweiz Wavestone Germany AG Vollzeit

    Job Title: Senior Big Data System Architect with Kubernetes ExpertiseDescription:We are looking for an experienced Senior Big Data System Architect to lead the design and implementation of large-scale, fault-tolerant, distributed systems. The ideal candidate will have a strong background in Kubernetes and experience with physical Disaster Recovery testing in...

  • Big Data Expert

    Vor 2 Tagen

    Zürich, Zürich, Schweiz Intec Select Vollzeit

    We are looking for an experienced Big Data Expert to join our client's team in Zurich. As a key member of the team, you will be responsible for designing and developing big data systems involving Hadoop, PySpark, and Hive.The ideal candidate should have at least 10 years of IT experience with in-depth knowledge of big data technology. Strong skills in Python...

  • Data Engineer

    Vor 2 Tagen

    Zürich, Zürich, Schweiz Intec Select Vollzeit

    A market leading consultancy operating globally is seeking an experienced Big Data Engineer to join one of their Investment Banking clients in Zurich for a 6-month contract, with potential extensions.Key Responsibilities:Design and develop big data systems involving Hadoop, PySpark, HiveBuild complex data pipelines using Spark and PySparkTune the performance...

  • Big Data Lake Expert

    Vor 3 Tagen

    Zürich, Zürich, Schweiz Experis Switzerland Vollzeit

    We are looking for an experienced Big Data Lake Expert to lead our Big Data on-premise environment projects. The ideal candidate will have at least five years of experience in large data migration projects and Big Data architectures.You will work closely with development teams to implement data strategies and build efficient data flows, applying expertise in...

  • Big Data Specialist

    Vor 4 Tagen

    Zürich, Zürich, Schweiz II-VI UK, Ltd. Vollzeit

    We are seeking a highly skilled Big Data Specialist to join our team and help us design and implement a scalable data infrastructure for our hybrid on-premises and cloud environment.The ideal candidate will have experience with big data frameworks like Spark, cloud platforms (AWS or Azure), and a proven track record of managing complex data pipelines.Key...

  • Informatiker für Big Data

    Vor 7 Tagen

    Zürich, Zürich, Schweiz DevITjobs Vollzeit

    Ihre HerausforderungDu arbeitest in einem Team zusammen, um eine innovative, skalierbare Datenlösung im Bereich Big Data mit modernen Technologien zu implementieren.Der Kunde setzt dich gerne vor neue Herausforderungen.

  • Cloud-Based Big Data Specialist

    Vor 7 Tagen

    Zürich, Zürich, Schweiz Databricks Inc. Vollzeit

    Databricks Inc. is the go-to platform for organizations seeking to harness the power of data and AI.As a Sr. Solutions Engineer, you will be instrumental in delivering cutting-edge solutions to our customers, leveraging our Data Intelligence Platform.The role involves:Developing strong relationships with clients to provide value-added services.Evaluating and...

  • Data Analytics Engineer

    Vor 7 Tagen

    Zürich, Zürich, Schweiz DevITjobs Vollzeit

    Als Data Analytics Engineer bei DevITjobs steuerst du unsere Kundenberatung und entwickelst innovative Lösungen für komplexe Herausforderungen. Du bist ein Experte in der Konzeption von analytischen Infrastrukturen und setzt Big Data-Projekte mit modernen Technologien um.Unsere Hauptaufgaben sind:Daten aufbereiten und analysieren, um unser...

  • Big Data Engineering Manager

    vor 1 Tag

    Zürich, Zürich, Schweiz Robert Walters Vollzeit

    Data Engineering PositionWe are looking for a talented Senior Data Engineer to join our team at Robert Walters. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and ETL processes using Python, SQL, and Azure technologies.Key Accountabilities:Collaborate with cross-functional teams to gather...

  • Big Data Expert

    Vor 7 Tagen

    Zürich, Zürich, Schweiz European Tech Recruit Vollzeit

    Europtech International specializes in AI-powered recruitment services and is looking for an exceptional Senior Data Engineer to lead our data pipeline development. This is a unique opportunity to contribute to innovative projects and collaborate with talented individuals.About the Role:Design and implement scalable data architectures for efficient data...

  • Big Data Specialist

    Vor 7 Tagen

    Zürich, Zürich, Schweiz Noir Vollzeit

    About NoirNoir specializes in developing innovative AI solutions for various industries, focusing on finance, healthcare, and logistics. Our next-generation data architecture integrates with large-scale systems, enabling real-time predictive analytics.We are seeking skilled Data Engineers to join our team in Zurich and Lucerne. You will work on pioneering...

  • Senior Data Engineer

    Vor 7 Tagen

    Zürich, Zürich, Schweiz Noir Vollzeit

    Job OverviewWe are seeking a Senior Data Engineer to join our team at Noir in Linz, Austria. As a Senior Data Engineer, you will design, develop, and maintain large-scale data processing systems, working alongside AI pioneers on projects that push the boundaries of natural language processing, computer vision, and neural network optimization.Key...

  • Senior Big Data Professional

    vor 1 Tag

    Zürich, Zürich, Schweiz Robert Walters Vollzeit

    Job OverviewWe are seeking a highly skilled Senior Data Engineer to join our team at Robert Walters. The successful candidate will be responsible for leading our data engineering efforts and collaborating with cross-functional teams to design and develop scalable data pipelines and ETL processes.Main Responsibilities:Design and develop data models and...

  • Big Data Engineering Lead

    Vor 7 Tagen

    Zürich, Zürich, Schweiz paiqo GmbH Vollzeit

    Paiqo GmbH offers a unique opportunity for data engineers to grow professionally and contribute to innovative projects. Our team collaborates with clients from various sectors to build and maintain cloud-based data platforms. As a key member of our team, you will design, implement, and maintain scalable data architectures and develop efficient data...