Data engineer - data refinery lab

Job description
The newly established Data Refinery Lab, part of the Department of Architecture at Faculty of Architecture and the Built Environment, at the Delft University of Technology is currently seeking a highly skilled and proficient Data Engineer to join our innovative team. Our commitment lies in the development and application of FAIR (Findable, Accessible, Interoperable, Reusable) data and software solutions which are essential in propelling research and education in Architecture.

In this critical role, you will be instrumental in building the data foundation for our lab, focusing on:

• FAIR Data & Pipelines: You will design and implement data pipelines for ingesting, processing, and storing open data related to the built environment. This data will span various modalities, including imagery, 3D, text, and tabular data. Your role will ensure the quality of this data prepare it for user-friendly analysis and ensure seamless integration with existing tools.
• Data Management: You will collaborate with researchers to devise data management strategies that adhere to FAIR principles. Your tasks will include implementing data storage and access solutions that promote the discoverability, accessibility, and long-term usability of research data within the lab.
• Automation & Efficiency: You will develop and maintain automated workflows utilizing tools such as Python scripts, artificial intelligence, and cloud technologies to enhance data processing, cleaning, analysis, and software release processes.
• Dissemination & Publication: You will contribute to the scientific community by publishing datasets and software findings in reputable data and AI conferences and venues. Additionally, you will develop workshops and training sessions for the students and staff at the Faculty of Architecture and the Built Environment, enhancing their understanding and skills in these critical areas.

Job requirements

• Master's or PhD degree in Computer Science, Data Engineering, or a related field (or equivalent experience);
• Minimum of 3 years of experience as a Data Engineer or similar role if you don't have PhD;
• Strong programming skills in Python and experience with big data frameworks (e.g., Spark) are a plus;
• Experience with data warehousing, and database management systems (e.g., PostgreSQL, MySQL), is preferred;
• Experience with data quality control and data cleaning techniques;
• Familiarity with version control systems (Git) and continuous integration/continuous delivery (CI/CD) practices (e.g., GitHub Actions);
• Working knowledge of Linux server administration is a plus (optional, depending on the team structure);
• Understanding of FAIR data and software principles and practices;
• Excellent communication and collaboration skills;
• Passion for research and education in this field.

TU Delft (Delft University of Technology)
Delft University of Technology is built on strong foundations. As creators of the world-famous Dutch waterworks and pioneers in biotech, TU Delft is a top international university combining science, engineering and design. It delivers world class results in education, research and innovation to address challenges in the areas of energy, climate, mobility, health and digital society. For generations, our engineers have proven to be entrepreneurial problem-solvers, both in business and in a social context.

At TU Delft we embrace diversity as one of our core values and we actively engage to be a university where you feel at home and can flourish. We value different perspectives and qualities. We believe this makes our work more innovative, the TU Delft community more vibrant and the world more just. Together, we imagine, invent and create solutions using technology to have a positive impact on a global scale. That is why we invite you to apply. Your application will receive fair consideration.

Challenge. Change. Impact!
Faculty Architecture and the Built Environment
The Faculty of Architecture and the Built Environment has a leading role in education and research worldwide. The driving force behind the faculty's success is its robust research profile combined with the energy and creativity of its student body and academic community. It is buzzing with energy from early in the morning until late at night, with four thousand people studying, working, designing, conducting research and acquiring and disseminating knowledge. Our faculty has a strong focus on 'design-oriented research', which has given it a top position in world rankings.

Staff and students are working to improve the built environment with the help of a broad set of disciplines, including architectural design, urban planning, building technology, social sciences, process management, and geo-information science. The faculty works closely with other faculties, universities, private parties, and the public sector, and has an extensive network in the Netherlands as well as internationally.

to go to the website of the Faculty of Architecture and the Built Environment.

2 March 2025 via the application button and upload the following documents:

• CV.
• Motivational letter (no more than 600 words) addressing your interests and describing how your experience and plans fit with the position.
• Contact information for two references (letters not required at this stage).

Please note:

• A pre-employment screening can be part of the selection procedure.
• For the final candidates, a knowledge security check will be part of the application procedure. For more information on this check, please consult Chapter 8 of the National Knowledge Security Guidelines. We carry out this check on the basis of legitimate interest.
• Applying for an exemption for specific research and educational areas is an obligatory part of the selection procedure for this vacancy. This exemption must be obtained from the Ministry of Education, Culture and Science (OCW) before an employment contract is agreed upon. Click here for more information.
• Please do not contact us for unsolicited services.