Ranim Khojah

PhD Student in Computer Science

Chalmers University of Technology

I am a doctoral student in Computer Science and Engineering at Chalmers University of Technology funded by the Wallenberg AI, Autonomous Systems and Software Program (WASP). I am part of the Internet Computing and Emerging Technologies Lab (ICET-lab), where my research interests circle around large language models and chatbots, and how they can support software development. I am particularly interested in the human aspects of working with chatbots: how people actually use them, trust them, and fit them into their everyday development work. I hold a Master’s degree in Language Technology and a Bachelor’s degree in Software Engineering and Management from the University of Gothenburg.

Selected Publications

See all publications.

Same Scrutiny, More Time: Eye Tracking Insights into Reviewing LLM-Labelled Code

Modern software development increasingly involves the use of large language models (LLMs) to generate code. Despite their rapid …

Ranim Khojah, Francisco Gomes de Oliveira Neto, Mazen Mohamad, Julian Frattini, Philipp Leitner

The Impact of Prompt Programming on Function-Level Code Generation

Large Language Models (LLMs) are increasingly used by software engineers for code generation. However, limitations of LLMs such as …

Ranim Khojah, Francisco Gomes de Oliveira Neto, Mazen Mohamad, Philipp Leitner

Beyond Code Generation: An Observational Study of ChatGPT Usage in Software Engineering Practice

Large Language Models (LLMs) are frequently discussed in academia and the general public as support tools for virtually any use case …

Ranim Khojah, Mazen Mohamad, Philipp Leitner, Francisco Gomes de Oliveira Neto

Talks & Presentations

Chatbots in Software Engineering Scientific highlights at the WASP Winter Conference (ca 500 attendees), Örebro, Sweden (2026)

Understanding and Evaluating Chatbots in Software Engineering Licentiate Seminar, Chalmers University of Technology, Gothenburg, Sweden (2025)

The Art of Using ChatGPT Innovation Fika (ca 300 attendees), Volvo Trucks, Gothenburg, Sweden (2024)

ChatGPT Usage in Software Engineering Practice Invited Talk, SystemWeaver, Gothenburg, Sweden (2024)

Programming without a Programming Language Workshop, Iceberry, Gothenburg, Sweden (2024)

Chatbots in Software Engineering Invited Talk, RISE Research Institutes of Sweden, Borås, Sweden (2024)

From Human-to-Human to Human-to-Bot Interactions in Software Engineering Paper presentation, AIware (Co-located with FSE), Porto de Galinhas, Brazil (2024)

Beyond Code Generation: An Observational Study of ChatGPT Usage in Software Engineering Practice Paper presentation, FSE, Porto de Galinhas, Brazil (2024)

Evaluating the Trade-offs of Text-based Diversity in Test Prioritisation Paper presentation, AST (co-located with ICSE), Melbourne, Australia (2023)

Evaluating N-best Calibration of Natural Language Understanding for Dialogue Systems Paper presentation, SigDIAL, Edinburgh, Scotland (2022)

Projects

Batata

Potato’s Way to Kitchen is a voice-based game implemented with xstate, React.js and Typescript. The player has to talk to Batata (the main character) to help him find the key to the kitchen so that Batata can join the potato party there.

C.A.R.L.O.S

C.A.R.L.O.S is a self-driving vehicle system built to autonomously handle intersections - stopping at signs, interpreting directional signage, reading vehicle queues, and avoiding obstacles. Developed as a microservices-based Cyber-Physical System for the DIT638 course.

MBTI Personality Predictor

A personality predictor that is based on the MBTI personality types; given a sentence or text input by the user (ideally associated to their values, beliefs, or simply related to them somehow) the system will predict to which personality type the text is mostly related with.

Otter

Otter is a movie/series recommendation system that works best for your movie nights and boring weekends! it’s completely speech-based, that is, Otter runs on spoken dialogue as the main interaction method with the user.

Academic Service

Committee Member:

• AIware Conference (co-located with ASE 2025) - Publicity chair

• BotSE Workshop (co-located with ICSE 2025) - Program committee member

• BoatSE Workshop (co-located with ICSE 2026) - Program committee member

• CAIN (co-located with ICSE 2027) - Proceedings chair

Student Volunteer:

• ICSE 2023 - Melbourne, Australia

• ICSE 2024 - Lisbon, Portugal

• ASE 2025 - Seoul, South Korea

Teaching duties:

• Data Management (2025-2026): Teaching, Assignment design, assessment.

• Fundamentals of Programming (2024-2025): Teaching, Creating course material.

• Object Oriented Programming (2018-2020, 2022-2023): Teaching, Creating course material, assessment.

• Distributed Systems (2024): Supervising and assessing project groups.

Thesis Supervision:

• “Tracybot: Tracing LLM-Generated Code to Prompts”
Bachelor thesis · Main supervisor · 2026
With Aliaksei Khval, Răzvan Albu, Maxine Orlova, Danis Music, and Filipe Araújo Veras Rosa

• “Evaluating the Potential Benefits of Using LLMs for Mutation Testing and Unit Test Generation”
Bachelor thesis · Main supervisor · 2026 · in collaboration with Ericsson
With Setareh Golchin Jouposhti and Tanya Nordh

• “Developer Behavior in Response to LLM-Generated Code Refactoring Suggestions”
Bachelor thesis · Main supervisor · 2025
With David Schön, Faiza Amjad, and Tehreem Asif

• “Leveraging Large Language Models for Cybersecurity Risk Assessment”
Master thesis · Co-supervisor · 2024 · in collaboration with RISE Research Institutes of Sweden
With Fikret Mert Gültekin and Oscar Lilja

Experience

Researcher (PhD student)

Chalmers University of Technology December 2022 – Present

PhD project (Chatbots in Software Engineering) funded by Wallenberg AI, Autonomous Systems and Software Program (WASP).

Software Developer

Volvo Trucks Technology September 2022 – November 2022

Automated the translation process followed in infotainment systems.

Teaching Assistant

Chalmers University of Technology June 2022 – August 2022

Patricipated in Girls Code Club (GCC); a coding camp that welcomes gymnasium students and women who are looking to pursue a career within software engineering and computer science.

Research Assistant

Chalmers University of Technology January 2021 – June 2022

Assistance with research related to FaaS applications. Performing data processing and analysis using NLP techniques.

Teaching Assistant

University of Gothenburg September 2018 – November 2022

Courses - Discrete Mathematics, Object-oriented Programming, Mobile and Web Development.