Skip to content
View sudoberlin's full-sized avatar
:octocat:
Practitioner
:octocat:
Practitioner

Block or report sudoberlin

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
sudoberlin/README.md

Shubham Singh

Robot learning · Vision-language-action models · Embodied AI

I study how reliably learned robot policies behave when their inputs shift away from what they were trained on. My current work is on vision-language-action models for manipulation, and the longer goal is to build robot systems end to end, from perception and learning through to control and kinematics.

Research

Instruction-phrasing brittleness in vision-language-action models (independent study, ongoing)

Does a robot policy act the same way when one request is worded differently? I hold the scene, camera and robot state fixed in SimplerEnv and change only the instruction given to OpenVLA, so any change in behaviour can be traced to language. The evaluation harness, paraphrase sets and metrics are public, and the GPU runs are in progress.

BetaOthello

A reinforcement learning agent for Othello whose value function is a Bayesian neural network, trained from self-play with variational inference. Built with Narendra Gangwani at UT Dallas.

Image inpainting with deep learning

Three approaches to filling in missing regions of face images on CelebA: a coarse-to-fine network with contextual attention, a context encoder, and a GAN baseline. Built with Jiazheng Liu and Marin Budic at UT Dallas.

Interests

Robot manipulation, robustness and evaluation of embodied AI policies, uncertainty in learned control, simulation-based evaluation, and the kinematics and control side of robotics.

Background

M.S. in Computer Science from UT Dallas and B.Tech in Electronics and Communication Engineering from NIT Nagaland.

I work as a software engineer on machine learning systems at Singular Analysts in Dallas. Before that I ported a production computer vision library from Java to C++ for wafer inspection at KLA, and built and deployed machine learning models at PNC.

Python, C++, PyTorch.

Pinned Loading

  1. vla-phrasing-brittleness vla-phrasing-brittleness Public

    Does a robot policy act the same when a request is reworded? Controlled paraphrase evaluation of OpenVLA on SimplerEnv. Work in progress.

    Python

  2. BetaOthello BetaOthello Public

    Othello agent with a Bayesian neural network value function, trained from self-play with variational inference.

    Jupyter Notebook

  3. image-inpainting image-inpainting Public

    Three deep-learning approaches to face image inpainting on CelebA: coarse-to-fine network with contextual attention, context encoder, GAN baseline. UT Dallas course project, 2023.

    Jupyter Notebook

  4. NLP_ND NLP_ND Public

    Udacity Natural Language Processing Nanodegree.

    HTML 2

  5. Computer_Vision_ND Computer_Vision_ND Public

    Udacity Computer Vision NanoDegree.

    Jupyter Notebook 1

  6. Deep_Learning_ND Deep_Learning_ND Public

    Udacity Deep Learning Nanodegree Program

    Jupyter Notebook 1