Ashmal Vayani

I am an MSc. student in the College of Engineering and Computer Science department at the University of Central Florida. I am a member of the Center for Research in Computer Vision (CRCV) Lab advised by Prof. Mubarak Shah.

Previously, I was a Research Engineer in the Computer Vision Department, affiliated with the IVAL-Lab at Mohamed bin Zayed University of Artificial Intelligence (MBZUAI). I was advised by Prof. Fahad Khan, and Dr. Salman Khan (Aug 2023 - Jul 2024). During my undergrad, I worked as a Research Intern at Retrocausal with Dr. Zeeshan Zia. I completed my Bachelors from National University of Computer and Emerging Sciences majoring in Computer Science (Aug 2019 - June 2023).

Email  /  CV  /  Google Scholar  /  Github  /  LinkedIn

profile photo

Research Interests

I mostly work on Large Language Models, Vision Language Models, their efficiency, and building downstream industrial applications using RAG methods and LLM deployment. I have also curated high-quality datasets and benchmarks for Multilingual LMMs, Bias Mitigation, and Industrial Applications for the MENA region.

News

  • [Oct 2024] - One Paper Accepted at NeurIPS Vision Language Models Workshop, 2024.
  • [Aug 2024] - Joined the UCF (CRCV) as a Master's in Computer Vision Student.
  • [Jan 2024] - Promoted to a Research Engineer at MBZUAI.
  • [Dec 2023] - Merit Award - Tertiary Student Project APICTA Awards held in Hong Kong 2023.
  • [Dec 2023] - People's Choice Award at APICTA Awards held in Hong Kong 2023.
  • [Nov 2023] - Released the Jais Climate as a Lead Engineer.
  • [Aug 2023] - Joined the MBZUAI as a Research Assistant.
    		•

    Publications

    * denotes joint first authors
    VURF-diag VURF: A General-purpose Reasoning and Self-refinement Framework for Video Understanding
    Ashmal Vayani*, Ahmad Mahmood*, Muzammal Naseer, Salman Khan, Fahad Shahbaz Khan
    NeurIPS Vision Language Models Workshop 2024.
    Paper

    Mobillama-diag MobiLlama: Towards Accurate and Lightweight Fully Transparent GPT
    Omkar Thawakar*, Ashmal Vayani*, Salman Khan, Hisham Cholakkal, Rao Muhammad Anwer, Michael Felsberg, Timothy Baldwin, Eric P. Xing, Fahad Shahbaz Khan
    Under review
    Code / Paper