Skip to content
View mithilai's full-sized avatar

Block or report mithilai

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
mithilai/README.md

Typing SVG

I build neural networks from scratch and write down exactly how they work.
I research and prototype neural network systems early — then take the ones that work into production.


◆ Selected work

Text, image, audio and video in one shared 768-dim embedding space, trained end to end on a single RTX 4060 (8GB). An independent from-scratch reproduction of the GELATO architecture from Jina AI.

PyTorch · multimodal · contrastive

PyPI HF

Self-Adapting Language Models in a single readable file. The model writes its own fine-tuning data, tests whether it actually helped, and reinforces the habit. ReST-EM on 8GB, degrades gracefully to CPU.

LoRA · QLoRA · PEFT · ReST-EM

Paper Write-up

Gives Claude Desktop eyes through your webcam. Local vision via Ollama, temporal memory of the last five minutes, no cloud vision APIs. An MCP server that installs in three steps.

MCP · Ollama · local-first

Write-up

Engineering governance at the one place every change passes through: the commit. A managed global Git hook that stops credentials entering history, across every repo on a team.

Python · git-hooks · secret-scanning

PyPI

Python port. Original design and detection engine by Gaurang Joshi, Shrey Tandel and Dwij Acharya.

The invisible fingerprinting technique Netflix and music labels use to catch pirates, implemented cleanly in Python. Embed, detect, and everything that breaks it.

DSP · watermarking · NumPy

Write-up

A retriever that returns real section titles instead of chunk IDs. An open reimplementation of STAIR, with constrained decoding over a trie so it can never cite a section that doesn't exist. Mistral-7B QLoRA in 5GB.

Mistral-7B · QLoRA · generative retrieval

Write-up

All repositories →


◆ Open source

PYPI
quadembed
Multimodal embeddings for text, image, audio and video in one vector space. Weights on Hugging Face.

pip install quadembed

PYPI
gforge-python
A git firewall: a global pre-commit hook that blocks commits containing secrets.

pip install gforge-python

HUGGING FACE
yolov8-license-plate-detector
Edge-ready YOLOv8 detector exported to Keras, TFLite and Core ML.


◆ Expertise

Multimodal Video Intelligence Speech & Real-Time Transcription Computer Vision at the Edge
Document Intelligence Agentic Systems & Automation Media Forensics

◆ Stack

MODELLING  Transformers · PEFT · KerasCV · ONNX
AGENTS  MCP · CrewAI · LangChain · Ollama · n8n
PRODUCT  Vercel · Supabase

◆ Writing

Everything on Medium →


◆ From the channel


n8n Beginner Tutorial Build Your First Automation Workflow

How to Self Host n8n on Your Computer Using Docker Beginner Guide | Part - 2

How to Self Host n8n on Your Computer Using Docker Beginner Guide | Part - 1

Subscribe on YouTube →


◆ Contributions

contribution snake

Open to research collaborations and applied AI work — email · book a call · LinkedIn

Popular repositories Loading

  1. stair-toc-retrieval stair-toc-retrieval Public

    Open reimplementation of STAIR: structure-aware generative retrieval that returns real section titles instead of chunk IDs. Constrained decoding gives 0.00% hallucination. Runs Mistral-7B QLoRA in …

    Python 5 1

  2. gforge-python gforge-python Public

    Python 2

  3. YOLOv8-License-Plate YOLOv8-License-Plate Public

    Jupyter Notebook 1

  4. SEAL SEAL Public

    Python 1

  5. QuadEmbed QuadEmbed Public

    Python 1

  6. mithilai mithilai Public