Kumar Ayush

I am a lead research engineer at Google AI working on Health AI Foundation Models. I am also a PhD student at Stanford University studying machine learning and foundation models for healthcare.

I recieved my Master's in Computer Science (with Distinction in Research) from Stanford University and Bachelor's in Computer Science and Engineering with Honours from IIT Kharagpur where I also received the Best Bachelor's Thesis Award. My work has been recognized by Forbes 30 under 30 in Science category. I have also featured in Forbes 30 under 30 India as a Special Mention in the Artificial Intelligence catrogy.

Currently, I am building large-scale foundational models and multimodal LLMs for wearable sensor data to provide consumers with personalized health insights.

I am looking for student researchers/research interns with experience in large scale multimodal foundation models and their applications to healthcare, please reach out if you are interested.

Selected Publications

SensorLM: Learning the Language of Wearable Sensors

Kumar Ayush*, Yuwei Zhang*, Siyuan Qiao, A. Ali Heydari, Girish Narayanswamy, Maxwell A Xu, Ahmed Metwally, Jinhua Xu, Jake Garrison, Xuhai Xu, Tim Althoff, Yun Liu, Pushmeet Kohli, Mark Malhotra, Shwetak Patel, Celilia Mascolo, Xin Liu, Daniel McDuff, Yuzhe Yang

Under Review - pdf

LSM-2: Learning from Incomplete Wearable Sensor Data

Maxwell A Xu*, Girish Narayanswamy*, Kumar Ayush, Dimitris Spathis, Shun Liao, Shyam A. Tailor, Ahmed Metwally, A. Ali Heydari, Yuwei Zhang, Jake Garrison, Samy Abdel-Ghaffar, Xuhai Xu, Ken Gu, Jacob Sunshine, Ming-Zher Poh, Yun Liu, Tim Althoff, Shrikanth Narayanan, Pushmeet Kohli, Yuzhe Yang, Mark Malhotra, Shwetak Patel, James Matthew Rehg, Xin Liu, Daniel McDuff

Under Review - pdf

Learn Globally, Speak Locally: Bridging the Gaps in Multilingual Reasoning

Jaedong Hwang*, Kumar Tanmay*, Seok-Jin Lee, Ayush Agrawal, Hamid Palangi, Kumar Ayush, Ila R Fiete, Paul Pu Liang

Under Review

RADAR: Benchmarking Language Models on Imperfect Tabular Data

Ken Gu, Zhihan Zhang, Kate Lin, Yuwei Zhang, Akshay Paruchuri, Hong Yu, Mehran Kazemi, Kumar Ayush, A. Ali Heydari, Maxwell A Xu, Yun Liu, Ming-Zher Poh, Yuzhe Yang, Mark Malhotra, Shwetak Patel, Hamid Palangi, Xuhai Xu, Daniel McDuff, Tim Althoff, Xin Liu

Under Review - pdf | Code | Dataset

Language Models’ Factuality Depends on the Language of Inquiry

Tushar Aggarwal*, Kumar Tanmay*, Ayush Agrawal*, Kumar Ayush, Hamid Palangi, Paul Pu Liang

Submitted to EMNLP 2025 - pdf

Substance over style: Evaluating Proactive Conversational Coaching Agents

Vidya Srinivas, Xuhai Xu, Xin Liu, Kumar Ayush, Isaac Galatzer-Levy, Shwetak Patel, Daniel McDuff, Tim Althoff

ACL 2025 - pdf

Scaling Wearable Foundation Models

Girish Narayanswamy*, Xin Liu*, Kumar Ayush, Yuzhe Yang, Xuhai Xu, Shun Liao, Jake Garrison, Shyam Tailor, Jake Sunshine, Yun Liu, Tim Althoff, Shrikanth Narayanan, Pushmeet Kohli, Jiening Zhan, Mark Malhotra, Shwetak Patel, Samy Abdel-Ghaffar, Daniel McDuff

ICLR 2025 - pdf | Google AI blog

Transforming Wearable Data into Health Insights using Large Language Model Agents

Mike A. Merrill, Akshay Paruchuri, Naghmeh Rezaei, Geza Kovacs, Javier Perez, Yun Liu, Erik Schenck, Nova Hammerquist, Jake Sunshine, Shyam Tailor, Kumar Ayush, Hao-Wei Su, Qian He, Cory McLean, Mark Malhotra, Shwetak Patel, Jiening Zhan, Tim Althoff, Daniel McDuff, Xin Liu

Preprint - pdf | Google AI blog

Diverse cell-specific patterns of alternative polyadenylation in Drosophila

Seungjae Lee, Yen-Chung Chen, Kumar Ayush (Part of FCA Consortium), Austin E. Gillen, J. Matthew Taliaferro, Bart Deplancke, Hongjie Li, Eric C. Lai.

Nature Communications - pdf

Fly Cell Atlas: a single-cell transcriptomic atlas of the adult fruit fly

Hongjie Li, ..., Kumar Ayush (Part of FCA Consortium), ..., Stein Aerts

Science - pdf | webpage

Efficient Conditional Pre-training for Transfer Learning

Shuvam Chakraborty, Kumar Ayush*, Burak Uzkent*, Kumar Tanmay, Evan Sheehan, Stefano Ermon

CVPR L3D-IVU 2022 - pdf

Geography-Aware Self-Supervised Learning

Kumar Ayush*, Burak Uzkent*, Chenlin Meng*, Kumar Tanmay, Marshall Burke, David Lobell, Stefano Ermon

ICCV 2021 - pdf | webpage | code

Negative Data Augmentation

Kumar Ayush*, Abhishek Sinha*, Jiaming Song*, Burak Uzkent, Hongxia Jin, Stefano Ermon

ICLR 2021 - pdf | video

Efficient Poverty Mapping from High Resolution Remote Sensing Images

Kumar Ayush*, Burak Uzkent*, Kumar Tanmay, Marshall Burke, David Lobell, Stefano Ermon

AAAI 2020 (Oral) - pdf

Generating Interpretable Poverty Maps using Object Detection in Satellite Images

Kumar Ayush*, Burak Uzkent*, Marshall Burke, David Lobell, Stefano Ermon

IJCAI 2020 - pdf

SieveNet: A Unified Framework for Robust Image-Based Virtual Try-On

Kumar Ayush*, Surgan Jandial*, Ayush Chopra*, Mayur Hemani, Abhijeet Halwai, Balaji K

WACV 2020 (also at AI for Content Creation Workshop, CVPR 2020) - pdf | Venture Beat | Beebom | Adobe Blog

Towards a Unified Framework for Fashion Compatibility and Outfit Recommendation

Kumar Ayush*, Anirudh Singhal*, Utkarsh Patel*, Ayush Chopra*, Balaji K

WACV 2020 - pdf

Powering Virtual Try-On via Auxiliary Human Segmentation Learning

Kumar Ayush*, Surgan Jandial*, Ayush Chopra*, Balaji K

Second Workshop on Computer Vision for Fashion, Art and Design @ ICCV 2019 - pdf

Robust Cloth Warping via Multi-Scale Patch Adversarial Loss for Virtual Try-On Framework

Kumar Ayush*, Surgan Jandial*, Ayush Chopra*, Mayur Hemani, Balaji K

10th International Workshop on Human Behaviour Understanding (HBU) @ ICCV 2019 - pdf

Improving Classification Performance of Support Vector Machines via Guided Custom Kernel Search

Kumar Ayush*, Abhishek Sinha*

The Genetic and Evolutionary Computation Conference (ACM GECCO) 2019 - pdf

Powering Robust Fashion Retrieval with Information Rich Feature Embeddings

Ayush Chopra, Abhishek Sinha, Hiresh Gupta, Mausoom Sarkar, Kumar Ayush, Balaji K

Understanding Subjective Attributes of Data: Focus on Fashion and Subjective Search Workshop @ CVPR 2019 - pdf

Best Paper Award

Supporting Throughput Fairness in IEEE 802.11ac Dynamic Bandwidth Channel Access: A Hybrid Approach

Kumar Ayush, Raja Karamakar, Varun Rawal, Pradyumna K. Bishoyi, Samiran Chattopadhyay, Sandip Chakraborty

IEEE Conference on Local Computer Networks (LCN) 2017 - pdf | slides

Enhanced Personalized Targeting using Augmented Reality

Gaurush Hiranandani, Kumar Ayush, Atanu R Sinha, Sai Varun Reddy Maram, Chinnaobireddy Varsha, Pranav Maneriker

IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2017 - pdf

Generative Adversarial Learning for Reducing Manual Annotation in Semantic Segmentation on Large Scale Microscopy Images: Automated Vessel Segmentation in Retinal Fundus Image as Test Case

Avisek Lahiri, Kumar Ayush, Prabir Kumar Biswas, Pabitra Mitra

Computer Vision for Microscopy Image Analysis (CVMI) Workshop @ CVPR 2017 - pdf | slides | code

DeepFix: A Fully Convolutional Neural Network for predicting Human Eye Fixations

Srinivas S. S. Kruthiventi, Kumar Ayush, R. Venkatesh Babu.

IEEE Transactions on Image Processing 2017 - pdf | slides

Winner of Saliency Prediction - Large Scale Scene Understanding Challenge @ CVPR 2016


Patents

Machine Learning Models for Mapping Between Image Sensor Color Patterns

Kumar Ayush, Maria Lyubimsteva, Zihan Xu, Desmond Kamas, Hemang Mehta, Vitalii Dziuba, Ed Chang

GP-307568-00-PCT - Filed

Learning-based Camera Auto-Focus Prediction for Sparse Phase Detection Imaging Sensors

Kumar Ayush*, Stanley Chen*, Joa Lerman*, Zihan Xu*, Maria Lyubimtseva*, Ed Chang, Andrey Yatsunenko, Katrina Passarella, Jwalant Bhatt, David Tian, Desmond Kamas, Hemang Mehta, Gerardo Carranza, Vitalii Dziuba

PCT/US23/17752 - Filed

Video Retrieval Based on Encoding Temporal Relationships Among Video Frames

Kumar Ayush, Harnish Lakhani, Atishay Jain

US 11,238,093 - pdf

Deep Learning based Visual Compatibility Prediction for Bundle Recommendations

Kumar Ayush, Ayush Chopra, Utkarsh Patel, Balaji K, Anirudh Singhal

US 18/186,528 - pdf

Video Retrieval Using Temporal Video Content

Kumar Ayush, Harnish Lakhani, Atishay Jain

US 16/601,773 - pdf

Machine Learning Predictions of Recommended Products in Augmented Reality Environments

Kumar Ayush, Harnish Lakhani, Atishay Jain

US 16/675,606 - pdf

Augmented Viewpoint Driven Bundle Recommendation in Virtual Commerce

Kumar Ayush, Atishay Jain, Harnish Lakhani

US 17/654,885 - Filed

Accurately Generating Virtual Try-On Images Utilizing a Unified Neural Network Framework

Kumar Ayush, Surgan Jandial, Ayush Chopra, Mayur Hemani, Balaji K

US 11,030,782 - pdf

Cloth warping using multi-scale patch adversarial loss

Kumar Ayush, Surgan Jandial, Ayush Chopra, Mayur Hemani, Balaji K

US 11,080,817 - pdf

Center-Biased Machine Learning Techniques to Determine Saliency in Digital Images

Kumar Ayush, Atishay Jain

US 11,663,463 - pdf

Performance of Neural Networks Using Learned Specialized Transformation Functions

Kumar Ayush*, Abhishek Sinha*, Ayush Chopra*, Hiresh Gupta*, Mausoom Sarkar*, Balaji K

US 16/534,856 - pdf

Compatibility Based Identification of Incompatible Products in Digital Representations of Real-World Environments

Kumar Ayush, Harnish Lakhani, Atishay Jain

US 10,984,467 - pdf

Automatic Generation of Context-Aware Composite Images

Kumar Ayush, Harsh Vardhan Chopra

US 11,158,100 - pdf

Generating and Providing Augmented Reality Representations of Recommended Products Based on Style Compatibility in Relation to Real-World Surroundings

Kumar Ayush, Gaurush Hiranandani

US 10,789,622 - pdf

Generating and Providing Augmented Reality Representations of Recommended Products Based on Style Similarity in Relation to Real-World Surroundings

Kumar Ayush, Gaurush Hiranandani

US 10,956,967 - pdf

Creating Personalized Catalogues with Recommendations Embedded in Augmented Viewpoint to Retarget Consumers

Gaurush Hiranandani, Kumar Ayush, Sai Varun Maram Reddy, Chinnaobireddy Varsha, Siddhant Jain

AU 2017216603 - pdf

Method, Medium, and System for Product Recommendations based on Augmented Reality Viewpoints

Gaurush Hiranandani, Sai Varun Reddy Maram, Kumar Ayush, Chinnaobireddy Varsha, Siddhant Jain

US 10,475,103 - pdf

Creating Targeted Content based on Detected Characteristics of an Augmented Reality Scene

Gaurush Hiranandani, Kumar Ayush, Chinnaobireddy Varsha, Sai Varun Maram Reddy

US 10,922,716 - pdf

Product Recommendations Based on Augmented Reality Viewpoints

Gaurush Hiranandani, Sai Varun Maram Reddy, Kumar Ayush, Chinnaobireddy Varsha, Siddhant Jain

US 2018/0121988 - pdf

Identifying Augmented Reality Visuals Influencing User Behavior in Virtual-Commerce Environments

Gaurush Hiranandani, Chinnaobireddy Varsha, Sai Varun Maram Reddy, Kumar Ayush, Atanu R Sinha

US 10,163,269 - pdf