Selected Publications

We present algorithms for solving multi-armed and linear-contextual bandit tasks in the face of adversarial corruptions in the arm responses. Our algorithms are easy to implement and vastly outperform several existing UCB and EXP-style algorithms for stochastic and adversarial multi-armed and linear-contextual bandit problems. They enjoy minimax-optimal regret bounds, as well as can tolerate an adversary that is allowed to corrupt upto a universally constant fraction of the arms pulled by the algorithm.
Corruption-tolerant bandit learning, 2018

Projects

Neural IR

We are compiling a new data-set which can be used for the supervised training of Neural information retrieval models. We are also working on improving the existing neural-IR techniques by combining new ideas from deep learning with established principles in classic IR techiques. Our motivation is to leverage neural network techniques in relatively unexplored IR.

RKHS analysis for Local SGD

In continuation to the project on Local SGD, we are trying to analyse the infinite-dimensional setting. Our motivation is to understand the asymptotic constants involved in the converegence of Local SGD, hence understanding its behaviour more closely. We work in possibly infinite-dimensional RKHS setting, which has been previously used to give tighter rates for SGD like algorithms.

Local SGD

This Project is to be submitted at AISTATS 2019! We give the first non-asymptotic analysis of the Local-SGD algorithm and compare it with the extreme variants of One-shot and Mini-batch averaging. We also provide lower bounds on communication frequency for Local-SGD to perform optimally i.e. constant times worse than Mini-batch averaging. Finally, we conduct experiments to verify our theoretical findings. Our work hugely improves upon the communication bottleneck faced by distributed optimization algorithms. Arxiv version coming soon…

Robust multi-armed bandit

This project has produced a publication in Springer Machine Learning Journal! We developed novel algorithms for multi-armed and linear bandits, with provably optimal mini-max guarantees, and corruption tolerance against a universally corrupting adversary. Our algorithms experimentally outperform the state of the art UCB and EXP style algorithms with a huge margin.

Time Series Analysis

In this project we study the urban heat effect in the city of Ghent, Belgium by using standard techniques from time-series analysis. Our models are successul in explaining the behaviour observed in over year of climate data-set from various locations within the city.

One-shot Learning in Humans

We first do a brief review of some recent attempts to model sparse learning in humans, using non-paramteric statistics. We present our computational model of one shot learning, an area broadly studied in machine learning using non-parametric Bayesian modelling. It is followed by some experiments with human subjects to prove a part of this hypothesis. We verify a former hypothesis which links surprise to sparse learning of reward-penalty correlation with image stimuli.

Paraphrase Generation

We leverage variational auto-encoders to provide a novel generational model for controlled paraphrasing, using attention, and pre-fixed latent variables. Our results are qualitatively and quantitatively comparable to existing state of the art techniques. We also experiment with the popular evaluation techniques in Machine Translation like Bleu, etc. and demonstrate how they are insufficeint for the paraphrasing task.

Cognitive Architecture

We develope on the existing cognitive architecture based on fuzzy Z-numbers and recent work in cognitive sciences. Specifically we add skills like extraction and consolidation to the architecture by linking language processing levels in linguistics to atomic cognitive abilities and operators defined in the model. In doing so we leverage the current Z*-algebra and knowledge representation techniques.

Recent & Upcoming Talks

ICML Debriefing Session
Jul 31, 2018 10:00 AM
A Non-asymptotic Analysis of Local SGD
Jun 21, 2018 10:00 AM
Distributed SGD
Apr 25, 2018 10:00 AM

Recent Posts

I hail from the small town of Neemuch in Central India at the border of the two states of Madhya Pradesh and Rajasthan. I have grown up in a classic nuclear-joint-nuclear family with a dog and am in love with the small-town/village culture of India, which I have proudly been a part of for atleast the first 16 years of my life. I completed my primary and middle school in Spring Wood School Neemuch, while I trained in the Hindustani Classical Music for four years at the Gandharva Sangit Mahavidhyalaya, Neemuch.

CONTINUE READING

Contact