OPEN INNOVATION

We promote Open Innovation in India by Fostering partnership with university faculty and researchers.

SONY RESEARCH INDIA FELLOWSHIP

Professor Chiranjib Bhattacharyya

Professor & Chair, CSA Dept.,Indian Institute of Science (IISc) Banglore

Sony Research India has established Fellowships in 2022 for M.Tech and Ph.D. students under the guidance of Prof. Chiranjib Bhattacharyya‬, Professor and Chair of the Department of Computer Science and Automation at Indian Institute of Science Bangalore in 2022 to support highly talented research students in the field of core Artificial Intelligence and its applications.

SPONSORED RESEARCH COLLABORATIONS

Prof. Suyash Awate
Professor, CSE Dept.,
Indian Institute of Technology (IIT) Bombay

Research Area:
 Computer Vision

Research Topic:
Deep Neural Networks for Image Analysis: Object Detection and Recognition

Prof. Anoop Namboodiri
Associate Professor, CVIT Lab, International Institute of Information Technology (IIIT) Hyderabad

Research Area:
Biometrics

Research Topic:
Deep Learning based Joint Fingerprint Verification and Liveness Detection

Prof. Sriram Ganapathy
Associate Professor, Learning and Extraction of Acoustic Patterns (LEAP) Lab, Indian Institute of Science (IISc) Bangalore

Research Area:
Media Analysis

Research Topic:
Automatic Speech Separation for Music Analysis using Deep Learning Methods

Prof. Sriparna Saha
Associate Professor, CSE Dept.,
Indian Institute of Technology (IIT)
Patna

Research Area:
Data Science

Research Topic:
Novel multi-modal recommendation system for online video recommendation

HEAR FROM OUR COLLABORATORS

Professor Sriram Ganapathy

Associate Professor,
Indian Institute of Science (IISc) Bangalore

“I have worked with Sony Research India on the interesting problem of speech to singing conversion and the automatic transcription of music. The collaboration has been rewarding and has resulted in advancing the research as well as in publications. The students involved in the project work also got an opportunity to learn the topics in industry relevant research. We will look forward to future collaborations with Sony Research India team.”

Professor Sriram Ganapathy

Associate Professor, Indian Institute of Science (IISc) Bangalore

“I have worked with Sony Research India on the interesting problem of speech to singing conversion and the automatic transcription of music. The collaboration has been rewarding and has resulted in advancing the research as well as in publications. The students involved in the project work also got an opportunity to learn the topics in industry relevant research. We will look forward to future collaborations with Sony Research India team.”

SONY RESEARCH AWARD PROGRAM

The Sony Research Award Program provides funding for cutting-edge academic research in India, the USA, Canada and selected European
countries. This has helped build a collaborative relationship between faculty and Sony researchers. With awards up to $150,000 USD*
per year for each accepted proposal, this program has created new opportunities for university faculties and research institutions
to engage in pioneering research that could drive new technologies, industries and the future. For more details, click here.

Congratulations to the award recipients of 2021 from India:

Prof. Srijith PK
Indian Institute of Technology
Hyderabad (IITH)
Prof. Arpita Patra
Indian Institute of Science,
Bangalore (IISc)

SONY RESEARCH INDIA CONSULTANCY PROGRAM

The Sony Research Award Program provides funding for cutting-edge academic research in India, the USA, Canada and selected European
countries. This has helped build a collaborative relationship between faculty and Sony researchers. With awards up to $150,000 USD*
per year for each accepted proposal, this program has created new opportunities for university faculties and research institutions
to engage in pioneering research that could drive new technologies, industries and the future. For more details, click here.

Congratulations to the award recipients of 2021 from India:

Prof. Vineeth N Balasubramanian
Indian Institute of Technology
Hyderabad (IITH)
Prof. Rajiv Ratn Shah
Indraprastha Institute of Information
Technology Delhi (IIITD)

PUBLICATIONS

|

Precise Event Spotting in Sports Videos: Solving Long-Range Dependency and Class Imbalance

Authors: Sanchayan Santra, Vishal Chudasama, Pankaj.W, Vineeth N. Balasubramanian
CVPR | 2025

|

Faster Machine Translation Ensembling with Reinforcement Learning and Competitive Correction

Authors: Kritarth Prasad, Mohammadi Zaki, Pratik Rakesh Singh, Pankaj W
NAACL | 2025

|

Enhancing Whisper's Accuracy and Speed for Indian Languages through Prompt-Tuning and Tokenization

Authors: Kumud Tripathi and Pankaj W.
ICASSP | 2025

|

Ready for You When You Are Back: Content-driven Session-based Recommendation for Continuity of Experience

Authors: Brijraj Singh, Sonal Dabral, Niranjan Pedanekar
AAAI | 2025

|

Enhancing Entertainment Translation for Indian Languages using Adaptive Context, Style and LLMs

Authors: Pratik Rakesh Singh, Mohammadi Zaki, Pankaj Wasnik
AAAI | 2025

|

EmoReg: Directional Latent Vector Modeling for Emotional Intensity Regularization in Diffusion-based Voice Conversion

Authors: Ashish Gudmalwar, Ishan Biyani, Nirmesh Shah, Pankaj S. Wasnik, Rajiv R. Shah
AAAI | 2025

|

LLM-BRec: Personalizing Session-based Social Recommendation with LLM-BERT Fusion Framework

Authors: Raksha Jalan, Tushar Prakash and Niranjan Pedanekar
Generative Information Retrieval (Gen-IR) workshop at the SIGIR conference | July 2024

Read More ➜

|

DubWise: Video-Guided Speech Duration Control in Multimodal LLM-based Text-to-Speech for Dubbing

Authors: Neha Sahipjohn, Ashishkumar Gudmalwar, Nirmesh Shah, Pankaj Wasnik, Rajiv Ratn Shah (IIIT Delhi)
INTERSPEECH | September 2024

Read More ➜

|

VECL-TTS: Voice Identity and Emotional Style Aware Cross-Lingual TTS

Authors: Ashishkumar Gudmalwar, Nirmesh Shah, Sai Akarsh, Pankaj Wasnik, Rajiv Ratn Shah (IIIT Delhi)
INTERSPEECH | September 2024

Read More ➜

|

Cross-Modal Fusion and Attention Mechanism for Weakly Supervised Video Anomaly Detection

Authors: Ayush Ghadiya, Purbayan Kar ,Vishal Chudasama, Pankaj Wasnik
Computer Vision and Pattern Recognition (CVPR) 7th MULA Workshop | June 2024

Read More ➜

|

Isometric Neural Machine Translation using Phoneme Count Ratio Reward-based Reinforcement Learning

Authors: Shivam Ratnakant Mhaskar, Nirmesh Shah, Mohammadi Zaki, Ashishkumar Gudmalwar, Pankaj Wasnik, Rajiv Ratn Shah (IIIT Delhi)
Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL),: findings | June 2024

Read More ➜

|

Efficacy of Large Language Models in Predicting Hindi Movies' Attributes: A Comprehensive Survey and Content-Based Analysis

Authors: Prabir Mondal (IIT Patna), Siddharth Singh (IIT Patna), Kushum (IIT Patna), Sriparna Saha (IIT Patna), Jyoti Prakash Singh (IIT Patna), Brijraj Singh, Niranjan Pedanekar
WebConf (WWW) | May 2024

Read More ➜

|

Optimizing Movie Selections: A Multi-Task, Multi-Modal Framework with Strategies for Missing Modality Challenges

Authors: Subham Raj (IIT Patna), Pawan Agrawal (IIT Patna), Sriparna Saha (IIT Patna), Brijraj Singh, Niranjan Pedanekar
ACM Symposium on Applied Computing (SAC) | April 2024

Read More ➜

|

Estimation of individual causal effects in network setup for multiple treatments

Authors: Abhinav Thorat, Ravi Kolla, Niranjan Pedanekar, Naoyuki Onoe
38th Annual Association for the Advancement of Artificial Intelligence (AAAI) Conference on Artificial Intelligence [Graphs and Complex Structure for Learning and Reasoning (GCLR) Workshop] | February 2024

Read More ➜

|

Open-set Object Detection By Aligning Known Class Representations

Authors: Hiran Sarkar, Vishal Chudasama, Naoyuki Onoe, Pankaj Wasnik, Vineeth Balasubramanian (IIT Hyderabad)
Winter Conference on Applications of Computer Vision (WACV) | January 2024

Read More ➜

|

Efficient infusion of self-supervised representations in Automatic Speech Recognition

Authors: Darshan Prabhu, Saiganesh Mirishkar, Pankaj Wasnik
Poster presentation at the Neural Information Processing Systems (NeurIPS) 3rd Workshop | December 2023

Read More ➜

|

Enhancing Social Recommendation with Multi-View BERT Network

Authors: Tushar Prakash, Raksha Jalan, Naoyuki Onoe
IEEE International Conference on Data Mining (ICDM) | December 2023

Read More ➜

|

Fiducial Focus Augmentation for Facial Landmark Detection

Authors: Purbayan Kar, Vishal Chudasama, Naoyuki Onoe, Pankaj Wasnik, Vineeth Balasubramanian (IIT Hyderabad)
British Machine Vision Conference (BMVC) | November 2023

Read More ➜

|

Impulsion of Movie's Content-Based Factors in Multi-Modal Movie Recommendation System

Authors: Prabir Mondal (IIT Patna), Pulkit Kapoor (IIT Patna), Siddharth Singh (IIT Patna), Prof. Sriparna Saha (IIT Patna), Naoyuki Onoe, Brijraj Singh
International Conference on Neural Information Processing (ICONIP) | November 2023

Read More ➜

|

LLM Based Generation of Item-Description for Recommendation System

Authors: Arkadeep Acharya, Brijraj Singh, Naoyuki Onoe
Recommender Systems Conference (RECSYS) | September 2023

Read More ➜

|

CR-SoRec: BERT driven Consistency Regularization for Social Recommendation

Authors: Tushar Prakash, Raksha Jalan, Brijraj Singh, Naoyuki Onoe
Recommender Systems Conference (RECSYS) | September 2023

Read More ➜

|

Iteratively Improving Speech Recognition and Voice Conversion

Authors: Mayank Kumar Singh, Naoya Takahashi, Onoe Naoyuki
INTERSPEECH | August 2023

Read More ➜

|

Cd-HRNN: Content-Driven HRNN to Improve Session-Based Recommendation System

Authors: Sonal Dabral, Brijraj Singh, Naoyuki Onoe
International Joint Conference on Neural Networks (IJCNN Main Conference) | April 2023

Read More ➜

|

A Multi-Modal Multi-Task Based Approach for Movie Recommendation

Authors: Sriparna Saha (IIT Patna), Naoyuki Onoe
International Joint Conference on Neural Networks (IJCNN Main Conference) | April 2023

|

A Meta-Learning Based Generative Model with Graph Attention Network for Multi-Modal Recommender Systems

Authors: Sriparna Saha (IIT Patna), Naoyuki Onoe
International Neural Network Society Workshop on Deep Learning Innovations and Applications (INNS DLIA)/International Joint Conference on Neural Networks (IJCNN) | April 2023

|

Task-Specific and Graph Convolutional Network Based Multi-Modal Movie Recommendation System in Indian Setting

Authors: Sriparna Saha (IIT Patna), Naoyuki Onoe
International Neural Network Society Workshop on Deep Learning Innovations and Applications (INNS DLIA)/International Joint Conference on Neural Networks (IJCNN) | April 2023

|

Revisiting Class Imbalance for End-to-end Semi-Supervised Object Detection

Authors: Purbayan Kar, Vishal Chudasama, Pankaj Wasnik, Naoyuki Onoe
Efficient Deep Learning for Computer Vision (ECV) Workshop in Computer Vision and Pattern Recognition (CVPR) | April 2023

Read More ➜

|

Nonparallel Emotional Voice Conversion For Unseen Speaker-Emotion Pairs Using Dual Domain Adversarial Network & Virtual Domain Pairing

Authors: Nirmesh Shah, Mayank Kumar Singh, Naoya Takahashi, Naoyuki Onoe
The International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | February 2023

Read More ➜

|

Hierarchical disentangled representation learning for singing voice conversion

Authors: Naoya Takahashi, Mayank Kumar Singh, Yuki Mitsufuji
The International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | February 2023

Read More ➜

|

Graph Network based Approaches for Multi-modal Movie Recommendation System

Authors: Daipayan Chakder (IIT Patna), Parbir Mondal (IIT Patna), Subham Raj (IIT Patna), Sriparna Saha (IIT Patna), Angshuman Gosh, Naoyuki Onoe
IEEE International Conference on System, Man, and Cybernetics (SMC) | November 2022

Read More ➜

|

Semi-supervised Acoustic and Language Modeling for Hindi ASR

Authors: Tarun Sai Bandarupalli (IISc Bangalore), Shakti Rath (IISc Bangalore), Nirmesh Shah, Onoe Naoyuki, Sriram Ganapathy (IISc Bangalore)
INTERSPEECH | September 2022

Read More ➜

|

Towards Developing a Multi-Modal Video Recommendation System

Authors: Sriram Pingali (IIT Patna), Prabir Mondal (IIT Patna), Daipayan Chakder (IIT Patna), Sriparna Saha (IIT Patna), Angshuman Ghosh
International Joint Conference on Neural Networks (IJCNN) | September 2022

Read More ➜

***International Institute of Information Technology Hyderabad **Indian Institute of Technology Patna *Indian Institute of Science, Bangalore #Michigan State University

View More

Our Director’s take on Open Innovation

Naoyuki Onoe

Associate Director, Sony Research India

“Research collaborations with Top-Tier institutes in India was one of my first roles when establishing  our R&D center in India. We believe such Open Innovation with excellent professors will enable Sony to create new technologies for India by combining academic research with our industrial expertise.”

Our Director’s take on Open Innovation

Dr. Naoyuki Onoe

Associate Director, Sony Research India

“Research collaborations with Top-Tier institutes in India was one of my first roles when establishing  our R&D center in India. We believe such Open Innovation with excellent professors will enable Sony to create new technologies for India by combining academic research with our industrial expertise.”
Skip to content