Senior Data Engineer
On site
Full-time
Lahore, Lisbon, Karlsruhe
Join us as a Senior Data Engineer with strong technical skills, agile expertise, and a client-focused mindset to drive innovative digital projects.
Job Overview
We are seeking a talented Data Engineer to join our AI team. In this role, you will architect and implement robust data pipelines and infrastructure that power our cutting-edge AI solutions for blue-chip clients. You will be responsible for designing scalable data systems that transform raw data into valuable insights, collaborating closely with data scientists and machine learning engineers to support model development and deployment. This position offers the opportunity to work with diverse datasets and advanced technologies while solving complex data challenges across multiple industries.
Responsibilities
- Design, build, and manage the implementation of data pipelines, integrating many data sources to support company goals.
- Develop and maintain large-scale data processing systems and machine learning pipelines, ensuring data availability and service quality.
- Implement systems for tracking data quality and consistency and work closely with Data Science and IT teams to ensure the data is accurate and readily available.
- Ensure software platforms and data handling comply with the company's security guidelines and the Software Development Life Cycle (SDLC) processes.
- Collaborate with the Data Science team, providing the necessary data infrastructure for their analyses and models.
- Lead and manage large-scale AI projects, working with cloud platforms to develop and deploy models.
- Maintain and optimize existing databases, design database schemas, and improve the flow of data and information across the organization.
Qualifications
- Bachelor’s degree in computer science, Engineering, or a related field.
- Minimum of 2 years of experience in data engineering, specifically in large-scale AI projects and production applications.
- Strong proficiency in Python, SQL, Spark, Cloud Architect, Data & Solution Architect, API, Databricks, and Azure.
- Deep understanding of designing and building scalable and robust data infrastructure.
- Experience with at least one public cloud provider.
- Strong understanding of system architecture and data pipeline construction.
- Familiarity with machine learning models and the requirements for data processing.
- Team player, analytical and problem-solving skills
- Good communication skills in English
Optional
- Expertise in distributed systems like Kafka and orchestration systems like Kubernetes.
- Basic knowledge in Data Lake/Data Warehousing/ Big data tools, Apache Spark, RDBMS and NoSQL, Knowledge Graph
To be ILI Digital
“To be ILI” means traveling far to reinvigorate innovation once again. It means vocation, commitment and passion. We are a highly selected taskforce with absolute focus: where we sense the innovation pulse, we actively start the conversation.
To be ILI Digital
“To be ILI” means traveling far to reinvigorate innovation once again. It means vocation, commitment and passion. We are a highly selected taskforce with absolute focus: where we sense the innovation pulse, we actively start the conversation.
ILI Digital is a strategic technology partner, empowering leading enterprises to innovate with confidence and scale with purpose.
We specialize in transforming complex business challenges into tailored software and AI-driven solutions, built to last, adapt, and lead.
Our team unites entrepreneurial thinkers, senior consultants, engineers, and designers to deliver value from day one.
Your life.
Your benefits.
We offer you a steep learning curve and further development opportunities in a flexible and positive working environment.
Best Working Environment
International Team
Dynamic and international teammates great to work with, open-minded, and always there to support you. After-work events such as barbecues, excursions, and different occasions for team gathering.
Health & Sports
Fresh fruit and vegetables, professional coffee machine, and self-made smoothies everyday. On-site private gym and yoga room to relax and take a break from work.
Your life.
Your benefits.
We offer you a steep learning curve and further development opportunities in a flexible and positive working environment.
Best Working Environment
Modern office with amazing design furniture pieces, including a great rooftop terrace on city view.
International Team
Dynamic and international teammates great to work with, open-minded, and always there to support you. After-work events such as barbecues, excursions, and different occasions for team gathering.
Health & Sports
Fresh fruit and vegetables, professional coffee machine, and self-made smoothies everyday. On-site private gym and yoga room to relax and take a break from work.