Data Engineer
Remote | Full Time | Lisbon
Data Engineer with 2+ years experience in AI, Python, SQL, Spark, Azure, Databricks. Skilled in scalable data infrastructure & pipeline design. English required.
Responsibilities
- Bachelor’s degree in computer science, Engineering, or a related field.
- Minimum of 2 years of experience in data engineering, specifically in large-scale AI projects and production applications.
- Strong proficiency in Python, SQL, Spark, Cloud Architect, Data & Solution Architect, API, Databricks, and Azure.
- Deep understanding of designing and building scalable and robust data infrastructure.
- Experience with at least one public cloud provider.
- Strong understanding of system architecture and data pipeline construction.
- Familiarity with machine learning models and the requirements for data processing.
- Team player, analytical and problem-solving skills
- Good communication skills in English
- Optional:
- Expertise in distributed systems like Kafka and orchestration systems like Kubernetes.
- Basic knowledge in Data Lake/Data Warehousing/ Big data tools, Apache Spark, RDBMS and NoSQL, Knowledge Graph
Requirements
- Design, build, and manage the implementation of data pipelines, integrating many data sources to support company goals.
- Develop and maintain large-scale data processing systems and machine learning pipelines, ensuring data availability and service quality.
- Implement systems for tracking data quality and consistency and work closely with Data Science and IT teams to ensure the data is accurate and readily available.
- Ensure software platforms and data handling comply with the company's security guidelines and the Software Development Life Cycle (SDLC) processes.
- Collaborate with the Data Science team, providing the necessary data infrastructure for their analyses and models.
- Lead and manage large-scale AI projects, working with cloud platforms to develop and deploy models.
- Maintain and optimize existing databases, design database schemas, and improve the flow of data and information across the organization.
To be ILI Digital
“To be ILI” means traveling far to reinvigorate innovation once again. It means vocation, commitment and passion. We are a highly selected taskforce with absolute focus: where we sense the innovation pulse, we actively start the conversation.
To be ILI Digital
“To be ILI” means traveling far to reinvigorate innovation once again. It means vocation, commitment and passion. We are a highly selected taskforce with absolute focus: where we sense the innovation pulse, we actively start the conversation.
There are lions in the zoo. And there are lions in the wilderness. A lion in the wild is constantly hunting for prey. It constantly activates all its senses in order to be able to act with the right strategy when an opportunity arises. Therefore it is awake, alert, and agile. A lion in the zoo loses its important hunting instinct gradually due to the guaranteed food supply. It is no longer constantly focused on picking up the scent of prey.
Your life.
Your benefits.
We offer you a steep learning curve and further development opportunities in a flexible and positive working environment.
Best Working Environment
International Team
Dynamic and international teammates great to work with, open-minded, and always there to support you. After-work events such as barbecues, excursions, and different occasions for team gathering.
Health & Sports
Fresh fruit and vegetables, professional coffee machine, and self-made smoothies everyday. On-site private gym and yoga room to relax and take a break from work.
Your life.
Your benefits.
We offer you a steep learning curve and further development opportunities in a flexible and positive working environment.
Best Working Environment
Modern office with amazing design furniture pieces, including a great rooftop terrace on city view.
International Team
Dynamic and international teammates great to work with, open-minded, and always there to support you. After-work events such as barbecues, excursions, and different occasions for team gathering.
Health & Sports
Fresh fruit and vegetables, professional coffee machine, and self-made smoothies everyday. On-site private gym and yoga room to relax and take a break from work.