I am a Software Engineer at Aselsan and a recent MSc graduate from Hacettepe University’s Computer Engineering Department, where I worked under the guidance of Erkut Erdem and Aykut Erdem. My research centers on natural language processing, with an emphasis on vision-language tasks and complex NLP problems. I am also involved in creating benchmarks and analysis tools, and I have a strong interest in foundation models. Previously, I earned my BSc from Konya Food and Agriculture University, where I collaborated with Kasim Oztoprak on sentiment analysis and computer architecture education.
Publications
2024 |
Evaluating Linguistic Capabilities of Multimodal LLMs in the Lens of Few-Shot Learning Mustafa Dogan, Ilker Kesen, Iacer Calixto, Aykut Erdem, Erkut Erdem arXiv, 2024 Paper This study evaluates the performance of Multimodal Large Language Models (MLLMs) on the VALSE benchmark, highlighting the significant impact of few-shot In-Context Learning and Chain-of-Thought prompting on complex reasoning tasks, and underscores the influence of pretraining datasets in optimizing MLLMs for better grounding in visual contexts. |
ViLMA: A Zero-Shot Benchmark for Linguistic and Temporal Grounding in Video-Language Models Ilker Kesen, Andrea Pedrotti, Mustafa Dogan, Michele Cafagna, Emre Can Acikgoz, Letitia Parcalabescu, Iacer Calixto, Anette Frank, Albert Gatt, Aykut Erdem, Erkut Erdem ICLR, 2024 Paper / Website / Code This study introduces ViLMA (Video Language Model Assessment), a task-agnostic benchmark designed to rigorously evaluate the fine-grained visio-linguistic capabilities of Video-Language Models, revealing that current models struggle with grounding abilities and perform similarly to static image-based models, particularly when evaluated with proficiency and counterfactual tests. |
Teaching computer architecture by designing and simulating processors from their bits and bytes Mustafa Dogan, Kasim Oztoprak, Mehmet Resit Tolun PeerJ Computer Science, 2024 Paper / MuSe Arc: Simulator Code / DoMe Arc: Simulator Code / MuSe Arc: Verilog Code / DoMe Arc: Verilog Code / YouTube Playlist This article highlights how team-based, hands-on projects, including designing and implementing a 16-bit MIPS-like processor, significantly enhance student motivation and knowledge in computer architecture courses, even in the absence of lab components, by engaging them in practical design, simulation, and verification phases, and shows that peer interactions further deepen their understanding of custom processor design. |
2020 |
Speculator and Influencer Evaluation in Stock Market by Using Social Media Mustafa Dogan, Omer Metin, Elif Tek, Semih Yumusak, Kasim Oztoprak IEEE International Conference on Big Data, 2020 Paper / Dataset (Tweet) / Dataset (Stock Market) This study investigates possible speculators or influencers on Twitter who may manipulate stock prices of major NASDAQ companies like Google, Amazon, Apple, Tesla, and Microsoft, using sentiment analysis and machine learning models, revealing that noise reduction is essential for accurate correlation, tweet volume does not correlate with company volume, threshold impacts accuracy, and the RBF Kernel SVM method outperforms other algorithms. |
Visits and Activities
Erasmus+ Yout Exchange Project: Interstellar Inclusion Perugia, Italy - 2019 Website / YouTube Video The "Interstellar Inclusion" Erasmus+ project brought together 36 young people from 6 countries to engage in a multicultural experience focused on fostering inclusivity, empathy, and intercultural awareness, using astronomy as a metaphorical framework to combat xenophobia and racism, promote European values, and empower participants through non-formal education activities such as team-building, intercultural nights, and interactive discussions. |
Visiting Sungeun Cho's Sensory Lab at Michigan State University Michigan State University, USA - 2018 A multidisciplinary experience at Sungeun Cho's Sensory Lab, where I explored the relationship between sleeping patterns and eating habits using Python libraries, applied Bayes Theorem to evaluate test results, and gained valuable insights through collaboration, contributing to ongoing research and offering practical applications for partnering companies. |
Erasmus+ Yout Exchange Project: Sail With EntrepreneurShip Nelijärve, Estonia - 2018 Website The "Sail With EntrepreneurShip" youth exchange, held in Tallinn, Estonia, from May 24th to June 1st, 2018, empowered 36 participants from seven countries in social entrepreneurship. The project focused on developing skills in creative thinking, financial management, and strategic planning through hands-on activities like role-plays and business model workshops. It aimed to tackle youth unemployment by equipping young people with practical tools to drive social change. |