Big Data System Engineer

Vor 5 Tagen

Zürich, Zürich, Schweiz Wavestone Germany AG Vollzeit

For an exciting project with our client in Zurich (remote work only possible within Switzerland), we are looking for a Big Data System Engineer / Platform Engineer (m/f/d).

Key Facts
Start: 02.05.2025
Duration: 6 months / + Verlängerungsoption
Capacity: 100 %
Employment type: Personal leasing
Job site: Zürich
Job country: Schweiz

Your tasks

• You are operating Global Data Platform components (VM Servers, Kubernetes, Kafka) and applications (Apache stack, Collibra, Dataiku and similar)

• Implement automation of infrastructure, security components, and Continuous Integration & Continuous Delivery for optimal execution of data pipelines (ELT/ETL)

• Develop solutions to build resiliency in data pipelines with platform health checks, monitoring, and alerting mechanisms, quality, timeliness, recency, and accuracy of data delivery are improved

• Apply DevSecOps & Agile approaches to deliver the holistic and integrated solution in iterative increments

• Liaison and collaborate with enterprise security, digital engineering, and cloud operations to gain consensus on architecture solution frameworks

• Review system issues, incidents, and alerts to identify root causes and continuously implement features to improve platform performance

• Stay up to date with the latest industry developments and technology trends to successfully lead and design new features and capabilities

Must have competences

• 5+ years of experience in building or designing large-scale, fault-tolerant, distributed systems

• Experience with physical Disaster Recovery testing in large data platforms on premise, with upstream and downstream pipelines

• Experience of agile project management and methods e.g., Scrum, SAFe)

• In-depth knowledge of all analytical value streams from enterprise reporting (e.g. Tableau) to data science (incl. ML Ops)

• Fluent in English, good knowledge of German is beneficial

• Hands-on working knowledge of large data solutions (for example: data lakes, delta lakes, data meshes, data lakehouses, data platforms, data streaming solutions…)

• In-depth knowledge and experience in one or more large scale distributed technologies including but not limited to: Hadoop ecosystem, Kafka, Kubernetes and Spark

• Expert in Python and Java or another static language like Scala/R, Linux/Unix scripting, Jinja templates and puppet scripts, firewall config rules setup

• Expertise in VM setup and scaling (pods), K8S scaling, managing Docker with Harbor, pushing Images through CI/CD

• Experience in integration of streaming and file based data ingestion / consumption (Kafka, Control M, AWA)

• Well-versed in DevOps, data pipeline development and automation using Jenkins and Octopus (optional: Ansible, Chef, XL Release, and XL Deploy)

• Experience predominately with on-prem Big Data architecture, cloud migration experience might come handy

• Hands-on experience in integrating Data Science Workbench platforms (e.g. Dataiku)

Nice to have competences

• Higher education e.g. "Fachhochschule","Wirtschaftsinformatik")

• Exposure to data formats such as Apache Parquet, ORC, or Avro Experience in machine learning algorithms is a plus

Let's power the future together
From Business Case to Implementation: As a leading consulting firm for strategic transformations, we are a trusted partner for our clients—and for our employees. Responsible, high-performing, and always with a focus on people. #WeAreWavestone
With our 360° portfolio of consulting services, we combine top-tier industry expertise with a wide range of cross-sector skills, work interdisciplinary, and think outside the box. This allows us to offer our partner companies and freelancers comprehensive perspectives within our own projects, while also supporting them as a long-standing framework agreement partner in filling project vacancies—promptly and directly.

We look forward to hearing from you

Your direct contact at Wavestone
Vivek Kandiah
Phone: +41 76 223 85 15
E-Mail: vivek.kandiah@wavestone.eu

Let's power the future together

Vom Business Case bis hin zur Umsetzung: Als führendes Beratungsunternehmen für strategische Transformationen sind wir vertrauenswürdiger Partner für unsere Kunden - und für unsere Mitarbeitenden. Verantwortungsvoll, leistungsstark und immer mit dem Menschen im Fokus. #WeAreWavestone

Mit unserem 360°-Portfolio an Beratungsleistungen verbinden wir erstklassige Branchenexpertise mit einem breiten Spektrum an branchenübergreifenden Kompetenzen, arbeiten interdisziplinär und denken über den Tellerrand hinaus. Unseren Partnerunternehmen und Freelancern:Freelancerinnen können wir so umfassende Perspektiven innerhalb unserer eigenen Projekte bieten und unterstützen als langjähriger Rahmenvertragspartner bei der Besetzung von Projektvakanzen – zeitnah und direkt.

Wir freuen uns über eine Kontaktaufnahme

  • Big Data/Pyspark Engineer

    Vor 4 Tagen

    Zürich, Zürich, Schweiz AMMGroup Vollzeit

    Job Title: Big Data/Pyspark EngineerLocation : Zurich, SwitzerlandJob Description:10+ years of IT experience with in-depth big data technologyConceptualize and design big data system involving Hadoop, PySpark, Hive.Extensively worked on Python and pyspark ProgrammingExperience in building complex data pipelines using Spark and especially PySpark Experience...

  • Big Data System Engineer

    Vor 2 Tagen

    Zürich, Zürich, Schweiz Experis Switzerland Vollzeit

    Experis is the global leader in professional resourcing and project-based workforce solutions.Overview of contractOn behalf of our client, a large bank in Switzerland, we are looking for a Big Data System Engineer (Platform Engineer).Location: ZurichStart date: NegotiableDuration: 12 months – with possibility of extension/ internalizationKey...

  • Big Data System Engineer

    Vor 5 Tagen

    Zürich, Zürich, Schweiz Wavestone Germany AG Vollzeit

    For an exciting project with our client in Zurich (remote work only possible within Switzerland), we are looking for a Big Data System Engineer / Platform Engineer (m/f/d). Key FactsStart: 02.05.2025Duration: 6 months / + VerlängerungsoptionCapacity: 100 %Employment type: Personal leasingJob site: ZürichJob country: SchweizYour tasks• You are operating...

  • Big Data Analytics Engineer

    vor 4 Wochen

    Zürich, Zürich, Schweiz ONE Agency | IT Recruitment Experts Vollzeit

    ONE Agency | IT Recruitment ExpertsBig Data Analytics EngineerÜber unseren KundenUnser Kunde ist ein IT UnternehmenIhr Aufgabenbereich- Unser Kunde befindet sich im Wachstum, welches sie aktiv mitgestalten können.- Sie werden zusammen im Team und deren Kunden einen wertvollen Beitrag im Bereich Softwaredesign und -implementierung für vielfältigen...

  • Senior Big Data System Architect with Kubernetes Expertise

    Vor 4 Tagen

    Zürich, Zürich, Schweiz Wavestone Germany AG Vollzeit

    Job Title: Senior Big Data System Architect with Kubernetes ExpertiseDescription:We are looking for an experienced Senior Big Data System Architect to lead the design and implementation of large-scale, fault-tolerant, distributed systems. The ideal candidate will have a strong background in Kubernetes and experience with physical Disaster Recovery testing in...

  • Big Data Expert

    Vor 3 Tagen

    Zürich, Zürich, Schweiz Intec Select Vollzeit

    We are looking for an experienced Big Data Expert to join our client's team in Zurich. As a key member of the team, you will be responsible for designing and developing big data systems involving Hadoop, PySpark, and Hive.The ideal candidate should have at least 10 years of IT experience with in-depth knowledge of big data technology. Strong skills in Python...

  • Data Engineer

    Vor 3 Tagen

    Zürich, Zürich, Schweiz Intec Select Vollzeit

    A market leading consultancy operating globally is seeking an experienced Big Data Engineer to join one of their Investment Banking clients in Zurich for a 6-month contract, with potential extensions.Key Responsibilities:Design and develop big data systems involving Hadoop, PySpark, HiveBuild complex data pipelines using Spark and PySparkTune the performance...

  • Big Data Lake Expert

    Vor 4 Tagen

    Zürich, Zürich, Schweiz Experis Switzerland Vollzeit

    We are looking for an experienced Big Data Lake Expert to lead our Big Data on-premise environment projects. The ideal candidate will have at least five years of experience in large data migration projects and Big Data architectures.You will work closely with development teams to implement data strategies and build efficient data flows, applying expertise in...

  • Data Engineer

    vor 3 Stunden

    Zürich, Zürich, Schweiz Intec Select Vollzeit

    Job Description:10+ years of IT experience with in-depth big data technologyConceptualize and design big data system involving Hadoop, PySpark, Hive.Extensively worked on Python and PySpark ProgrammingExperience in building complex data pipelines using Spark and especially PySparkExperience in performance tuning Spark applications.Experience in scheduling...

  • Big Data Specialist

    Vor 5 Tagen

    Zürich, Zürich, Schweiz II-VI UK, Ltd. Vollzeit

    We are seeking a highly skilled Big Data Specialist to join our team and help us design and implement a scalable data infrastructure for our hybrid on-premises and cloud environment.The ideal candidate will have experience with big data frameworks like Spark, cloud platforms (AWS or Azure), and a proven track record of managing complex data pipelines.Key...

  • Big Data Engineering Manager

    Vor 2 Tagen

    Zürich, Zürich, Schweiz Robert Walters Vollzeit

    Data Engineering PositionWe are looking for a talented Senior Data Engineer to join our team at Robert Walters. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and ETL processes using Python, SQL, and Azure technologies.Key Accountabilities:Collaborate with cross-functional teams to gather...

  • Senior Big Data Professional

    Vor 2 Tagen

    Zürich, Zürich, Schweiz Robert Walters Vollzeit

    Job OverviewWe are seeking a highly skilled Senior Data Engineer to join our team at Robert Walters. The successful candidate will be responsible for leading our data engineering efforts and collaborating with cross-functional teams to design and develop scalable data pipelines and ETL processes.Main Responsibilities:Design and develop data models and...

  • Cloud Data Engineer

    Vor 2 Tagen

    Zürich, Zürich, Schweiz Experis Switzerland Vollzeit

    We are looking for a skilled Cloud Data Engineer to join our team at Experis Switzerland. As a Cloud Data Engineer, you will be responsible for designing, implementing, and managing cloud-based data platforms using scalable and secure architectures.Key responsibilities include:Designing and implementing data pipelines using ELT/ETL tools.Developing and...

  • Data Platform Engineer

    Vor 4 Tagen

    Zürich, Zürich, Schweiz Wavestone Germany AG Vollzeit

    We are seeking a talented Data Engineer to join Wavestone Germany AG's team. In this role, you will be responsible for designing and implementing data solutions that meet business needs, collaborating with cross-functional stakeholders to drive data-driven decision making.Your Key Responsibilities:Design and develop datasets, data pipelines, and data...

  • Big Data and Cloud Platform Specialist

    Vor 4 Tagen

    Zürich, Zürich, Schweiz Wavestone Germany AG Vollzeit

    Job Overview:We are seeking an experienced Big Data and Cloud Platform Specialist to join our team. The ideal candidate will have a strong background in designing and implementing large-scale, fault-tolerant, distributed systems and experience with cloud migration.Responsibilities:Design and implement automation of infrastructure, security components, and...

  • Senior Big Data Specialist

    Vor 3 Tagen

    Zürich, Zürich, Schweiz Visium Vollzeit

    Unlock business potential with VisiumOur expertise in AI & Data enables executives to drive strategic decision-making.Job Description: Senior Data EngineerIn this role, you will:Analyze and improve client data landscapes and qualityPartner with stakeholders to ensure business objectives align with technical capabilitiesContribute to technical sales...

  • Cloud Data Engineer

    Vor 5 Tagen

    Zürich, Zürich, Schweiz II-VI UK, Ltd. Vollzeit

    We are looking for a highly skilled Cloud Data Engineer to join our team and help us design and implement a scalable data infrastructure for our hybrid on-premises and cloud environment.The ideal candidate will have experience with cloud platforms (AWS or Azure), big data frameworks like Spark, and a proven track record of managing complex data pipelines.Key...

  • Big Data Pipeline Architect

    vor 1 Tag

    Zürich, Zürich, Schweiz Xebia USA Vollzeit

    As a senior Data Engineer Consultant, you will play a central role in our clients' teams. We require at least 2 years of relevant professional experience. However, if you have done something outstanding during your studies, like contributing to open source projects or starting your own company, we encourage you to apply.Job ResponsibilitiesImplementing data...

  • System Architect and Engineer

    vor 1 Tag

    Zürich, Zürich, Schweiz Experis Switzerland Vollzeit

    About the RoleWe are looking for an experienced IT professional to join our team as a System Engineer.Key TasksDesign, implement, and maintain system infrastructure, including servers, networks, and storage.Collaborate with software developers, network engineers, and other IT staff to optimize system performance.Develop and maintain system documentation,...

  • Big Data Solutions Architect

    Vor 6 Tagen

    Zürich, Zürich, Schweiz Digitec Galaxus AG Vollzeit

    Welcome to Digitec Galaxus AG, where innovation meets opportunity. We're a leading e-commerce platform in Switzerland, Germany, and Serbia, dedicated to creating a seamless shopping experience for our customers.We're seeking a highly skilled Data Platform Engineer to join our team. As a key player in designing, implementing, and maintaining our data and...