Data Engineer

Our Mission
Ivy Partners is a Swiss consulting firm that assists companies in overcoming their strategic, technological, and organizational challenges.

We are committed to providing our employees with a career that promotes both their personal and professional development. We support their skill enhancement and offer them real opportunities for progression.

As a Data Engineer at Ivy Partners, you will be tasked with:
- Designing, developing, and maintaining end-to-end data ingestion pipelines that support batch, near real-time, streaming, and event-driven patterns.
- Building and maintaining connectors for various sources including APIs (REST), relational and NoSQL databases, filesystems (Windows, Linux, SharePoint), SaaS platforms, and more.
- Implementing data quality checks, validation rules, and data contracts as outlined by the client and Data Office.
- Applying robust software engineering practices in Python, including modular design, packaging, unit testing, and documentation.
- Implementing CI/CD pipelines and automation using Docker and GitHub Actions with disciplined Git workflows and code reviews.
- Performing integration testing in development environments and supporting production releases in collaboration with internal teams.
- Implementing monitoring, alerting, and dashboards to ensure observability and efficient troubleshooting.
- Taking operational ownership of delivered pipelines, including incident handling and hot fixes when required.
- Contributing to cost optimization and efficient resource usage with a FinOps-aware mindset.

About You
You are our ideal candidate if:
- You have over 5 years of experience as a Data Engineer with considerable exposure to data ingestion in production environments.
- You possess advanced Python skills demonstrated by your experience in building production-grade data pipelines.
- You have solid experience with PySpark and Pandas.
- You are experienced in using AWS and Databricks platforms.
- You have a strong track record with CI/CD and automation using Docker and GitHub Actions.
- You are skilled in integrating with APIs, including all aspects from authentication to robust error handling.
- You have implemented observability practices including logging, metrics, alerting, and run management.
- You maintain a strong Git discipline, featuring daily commits, feature branches, pull requests, and code reviews.
- You are fluent in English, both written and spoken.
- You hold a strong sense of ownership and autonomy, with the ability to thrive in high-expectation, delivery-focused environments.

Why Join Ivy Partners?

Care | We care about our employees by creating a supportive environment where everyone is valued and empowered with training and growth prospects.

Trust | We believe in building strong and long-lasting relationships with our clients. Working with us is about establishing a partnership based on trust, professionalism, and transparency at all times.

Innovation | We empower effective digital transformation through a unique blend of innovative technology and creative thinking.

Responsibility | Community is at the heart of everything we do, and we take that responsibility seriously by working hard to create a positive impact.

Apply

    Job Information

    Porto
    Porto
    Portugal
    Data Engineer
    Full-time
    Partial Remote