Dhruv Kumar

Assistant Professor at BITS PilaniOn Leave From IIIT Delhi
Post-Doc from Microsoft ResearchPhD from UMN Twin Cities

prof_pic_cropped.jpeg

6121-N, NAB

BITS Pilani

Pilani, Rajasthan - 333031

I am currently an assistant professor at BITS Pilani. I am currently on leave from IIIT Delhi where I have been since 2022. I continue to collaborate closely with students and faculty members at IIIT Delhi.

Before joining IIIT Delhi, I was a Post-Doc Researcher at Microsoft Research. Prior to Post-Doc, I completed my PhD under Abhishek Chandra in the Computer Science Department at the University of Minnesota, Twin Cities, USA. During my PhD, I also collaborated with Ramesh Sitaraman at University of Massachusetts, Amherst, USA. Long time back, I graduated in 2014 with a Bachelors in Computer Science from BITS, Pilani.

I consider myself a scientist before a computer scientist. Hence, I am interested in solving real life problems even if they are simple and/or not strictly related to computer science. I am particularly interested in solving problems which are specific to developing countries such as India.

As part of computer science research, I am primarily interested in Human-Computer Interaction, Computing Education and ICT4D. Sometimes, I also work on Distributed Systems, Data Analytics and Machine Learning.

News

Jul 25, 2024 Preprint released for our paper titled “TAMIGO: Empowering Teaching Assistants using LLM-assisted viva and code assessment in an Advanced Computing Class”
Jul 25, 2024 Preprint updated for our paper titled “Analyzing LLM Usage in an Advanced Computing Class in India”
May 5, 2024 Several newspapers and media outlets recently covered our research study on the impact of UPI on Spending Behavior among Indian Users. [Zee News] [Aaj Tak] [NDTV India] [Zee Business] [LallanTop] [India Today] [Aaj Tak] [NDTV Profit] [Full Details]
May 4, 2024 Our paper titled “A Comparative Analysis of Large Language Models for Code Documentation Generation” has been accepted to ACM AIware 2024
Apr 30, 2024 Our paper titled “Comuniqa: Exploring Large Language Models for improving English speaking skills” accepted in ACM COMPASS 2024.
Apr 19, 2024 Our paper titled “From Cash to Cashless: UPI’s Impact on Spending Behavior among Indian Users” accepted in ACM CHI 2024 - Late Breaking Work Track.
Mar 1, 2024 Received a research grant on “Predicting Breast Cancer subtype using MRI images” from iHub Anubhuti IIITD Foundation. This is a joint research project with MAX Healthcare, New Delhi. [Grant Amount: INR 99,42,000]
Feb 6, 2024 Preprint released for our paper titled “Which LLM should I use?: Evaluating LLMs for tasks performed by Undergraduate Computer Science Students in India”
Feb 1, 2024 Invited to attend Google Research@ Event, 2024 on Feb 1st in Bengaluru.
Jan 30, 2024 Preprint released for our paper titled “OpineBot: Class Feedback Reimagined Using a Conversational LLM”
Jan 30, 2024 Preprint released for our paper titled “AI as a Medical Ally: Evaluating ChatGPT’s Usage and Impact in Indian Healthcare”
Jan 15, 2024 Our paper titled “Unit Test Generation using Generative AI : A Comparative Performance Analysis of Autogeneration Tools” has been accepted to LLM4Code@ICSE 2024
Dec 13, 2023 Preprint released for our paper titled “Can ChatGPT Play the Role of a Teaching Assistant in an Introductory Programming Course?”
Nov 14, 2023 Received the Google Cloud Education Grant for teaching Distributed Systems at IIIT Delhi. [Grant Amount: INR 20,50,000]
Nov 13, 2023 Our paper on examining ChatGPT’s usage among undergraduate students in computer science accepted in ACE 2024.
Oct 4, 2023 Five UG students selected for CHANAKYA UG Fellowship 2023.
Oct 3, 2023 Our paper on evaluating ChatGPT on undergraduate computer science questions accepted in SIGCSE TS 2024.
Sep 29, 2023 Four UG students selected for Skilling@ARTPARK 2023 Fellowship.
Sep 20, 2023 Preprint released for our paper titled “Student and Instructor Perspectives on the influence of LLMs on Undergraduate Engineering Education”.
Sep 12, 2023 Received the Teaching Excellence Award for AY 2022-23.

Selected Publications

  1. arXiv 2024
    TAMIGO: Empowering Teaching Assistants using LLM-assisted viva and code assessment in an Advanced Computing Class
    Anishka IIITD, Diksha Sethi, Nipun Gupta, Shikhar Sharma, and 3 more authors
    2024
  2. arXiv 2024
    Analyzing LLM Usage in an Advanced Computing Class in India
    Anupam Garg, Aryaman Raina, Aryan Gupta, Jaskaran Singh, and 9 more authors
    2024
  3. arXiv 2024
    OpineBot: Class Feedback Reimagined Using a Conversational LLM
    Henansh Tanwar, Kunal Shrivastva, Rahul Singh, and Dhruv Kumar
    2024
  4. arXiv 2024
    "Which LLM should I use?": Evaluating LLMs for tasks performed by Undergraduate Computer Science Students in India
    Vibhor Agarwal, Nakul Thureja, Madhav Krishan Garg, Sahiti Dharmavaram, and 2 more authors
    2024
  5. COMPASS 2024
    Comuniqa : Exploring Large Language Models for improving speaking skills
    Manas Mhasakar, Shikhar Sharma, Apurv Mehra, Utkarsh Venaik, and 3 more authors
    2024
  6. arXiv 2024
    AI as a Medical Ally: Evaluating ChatGPT’s Usage and Impact in Indian Healthcare
    Aryaman Raina, Prateek Mishra, Harshit goyal, and Dhruv Kumar
    2024
  7. CHI LBW 2024
    From Cash to Cashless: UPI’s Impact on Spending Behavior among Indian Users
    Harshal Dev, Raj Gupta, and Dhruv Kumar
    2024
  8. LLM4Code 2024
    Unit Test Generation using Generative AI : A Comparative Performance Analysis of Autogeneration Tools
    Shreya Bhatia, Tarushi Gandhi, Dhruv Kumar, and Pankaj Jalote
    2024
  9. ACE 2024
    "It’s not like Jarvis, but it’s pretty close!" – Examining ChatGPT’s Usage among Undergraduate Students in Computer Science
    Ishika Joshi*, Ritvik Budhiraja*, Harshal D Akolekar, Jagat Sesh Challa, and 1 more author
    2024
  10. SIGCSE TS 2024
    ChatGPT in the Classroom: An Analysis of Its Strengths and Weaknesses for Solving Undergraduate Computer Science Questions
    Ishika Joshi*, Ritvik Budhiraja*, Harshal Dev, Jahnvi Kadia, and 4 more authors
    2024
  11. AIware 2024
    A Comparative Analysis of Large Language Models for Code Documentation Generation
    Shubhang Shekhar Dvivedi, Vyshnav Vijay, Sai Leela Rahul Pujari, Shoumik Lodh, and 1 more author
    2024
  12. arXiv 2024
    Can ChatGPT Play the Role of a Teaching Assistant in an Introductory Programming Course?
    Anishka, Atharva Mehta, Nipun Gupta, Dhruv Kumar, and 1 more author
    2024
  13. arXiv 2023
    "With Great Power Comes Great Responsibility!": Student and Instructor Perspectives on the influence of LLMs on Undergraduate Engineering Education
    Ishika Joshi*, Ritvik Budhiraja*, Pranav Deepak Tanna, Lovenya Jain, and 6 more authors
    2023
  14. CCGrid 2023
    AggFirstJoin: Optimizing Geo-Distributed Joins using Aggregation-Based Transformations
    Dhruv Kumar, Sohaib Ahmad, Abhishek Chandra, and Ramesh K. Sitaraman
    In 23RD IEEE/ACM INTERNATIONAL SYMPOSIUM ON Cluster, Cloud and Internet Computing, Bengaluru, India, May 1-4, 2023, 2023
  15. IPDPS 2022
    HACCS: Heterogeneity-Aware Clustered Client Selection for Accelerated Federated Learning
    Joel Wolfrath, Nikhil Sreekumar, Dhruv Kumar, Yuanli Wang, and 1 more author
    In 2022 IEEE International Parallel and Distributed Processing Symposium, IPDPS 2022, Lyon, France, May 30 - June 3, 2022, 2022
  16. SEC 2021
    AggNet: Cost-Aware Aggregation Networks for Geo-distributed Streaming Analytics
    Dhruv Kumar, Sohaib Ahmad, Abhishek Chandra, and Ramesh K. Sitaraman
    In 6th IEEE/ACM Symposium on Edge Computing, SEC 2021, San Jose, CA, USA, December 14-17, 2021, 2021
  17. SIGMETRICS 2019
    A TTL-based Approach for Data Aggregation in Geo-distributed Streaming Analytics
    Dhruv Kumar, Jian Li, Abhishek Chandra, and Ramesh K. Sitaraman
    SIGMETRICS, 2019