software

In a past life, I used to do a lot of software engineering. I have listed a few open-source projects I started (apart from research codebases). I have presented a few talks at software conferences which are also listed here.

selected software

MIRNet-TFJS

TensorFlow JS models for MIRNet for low-light💡 image enhancement that can run entirely on your browser.

(GitHub Trending)

Code Video

Fast-Transformer

An optimized implementation of Additive Attention.

(GitHub Trending)

Code PyPI

3D Transforms

A library to easily work with 3D data and make 3D transformations.

Code Project Webpage PyPI

Gradient-Centralization

Instantly improve your training performance by implementing Gradient Centralization in optimizers.

(GitHub Trending)

Code PyPI

Perceiver

An optimized implementation of Perceiver.

(GitHub Trending)

Code PyPI

ISAB

A framework to use Permutation-Invariant Neural Networks.

Code PyPI

ML With Android 11

Popular samples for optimized inference for machine learning models on Android using TensorFlow Lite using capabilities introduced in Android 11.

(GitHub Trending)

Code Video

TF Watcher

A tool to monitor your ML jobs remotely.

(GitHub Trending)

Code Project Webpage PyPI

Nystromformer

An optimized implementation of using Nyström Method for approximation self-attention.

Code PyPI

Transformer in Transformer

An optimized implementation of performing attention inside local patches for image classification.

Code PyPI

Conformer

One of the first implementations of the popular Conformer.

Code PyPI

GLOM

One of the first implementations of the popular Hinton's GLOM with optimization to make it runnable.

Code PyPI

GLU

Gated Linear Units and many of their variants.

Code PyPI

Compositional Attention

An optimized implementation of Compositional Attention and their variants around Disentangling Search and Retrieval.

Code PyPI

Invariant Point Attention

Invariant Point Attention from AlphaFold 2 for all problems.

Code PyPI

conference talks