Sarthak Gupta

Hi, I'm Sarthak!

I recently finished my IMSc. in Applied Mathematics at Indian Institute of Technology Roorkee. My google scholar is linked here and recent blog posts. Also, take a look at my backburner projects to see if something I tried and failed at resonates with you.

Contact

I like getting email. If you want to talk about something I do, send me an email or message me on Twitter.

Projects

Evaluating Open-Interpreter for Risky Code Generation and Execution - An evaluation of open-interpreter agent for risky code execution and generation. This project extends the analysis framework provided in RedCode: Risky Code Execution and Generation Benchmark for Code Agents to open-interpreter and also showcases how the analysis could further add tasks in other laguages. We generate evaluation samples in Rust, C++, Go,and Javascript. Detailed report here.
Attacking Invisible Watermarks - 6th place solution for the NeurIPS 2024 "Erasing the Invisible" competition, experimenting with various attack methods including basic perturbations, diffusion regeneration, and physical-world attacks to break image watermarks while preserving image quality;
[Re] Double Sampling Randomized Smoothing - Reproducibility study addressing neural network robustness certification against adversarial perturbations using DSRS framework with additional smoothing distributions, demonstrating improved certified robust radii on MNIST and CIFAR-10 datasets;
AIKavach - A certified adversarial robustness framework using randomized smoothing techniques including DSRS (Double Sampling Randomized Smoothing), ISS (Input-Specific Sampling), and Denoised Smoothing to provide provable defense against adversarial attacks on neural networks;
Microsoft Membership Inference Competition - 2nd place solution implementing membership inference attacks from first principles using LIRA methodology, achieving state-of-the-art performance at the SaTML 2023 competition through advanced statistical techniques and global variance optimization;
[Re] Distilling Knowledge via Knowledge Review - Reproducibility study of Chen et al.'s CVPR '21 knowledge distillation framework, analyzing cross-level connection paths between student and teacher networks with novel fusion modules and residual learning approaches for improved performance;

Side Quests

Deep Paper Search - A semantic search tool for academic papers using deep learning embeddings to help researchers discover relevant publications more effectively;
Surface Reconstruction using PHASE Loss - Implementation of PHASE Loss algorithm for surface reconstruction;
PINNs vs WENO - Comparative study between Physics-Informed Neural Networks (PINNs) and Weighted Essentially Non-Oscillatory (WENO) schemes for solving partial differential equations, recieved best master's thesis award for this;
3D Point Cloud Transforms - Collection of transformation algorithms and utilities for processing and manipulating 3D point cloud data;
Hangman - Trying to get max accuracy at letter-guessing game using character-level transformer networks.

Backburner Projects

While I've begun many projects, a good number of them didn't reach an end and are currently on the backburner. Would love to talk more about these and see if there's potential for revival and building something great out of these

City-Scale PseudoSattelites - Explored the possibility of using High Altitude Pseudo Satellites (HAPS) for urban monitoring and data collection while I was at EF. Turns out it takes a huge amount of legal and regulatory work to get these off the ground. If you're into aerospace and geo-imaging, would love to chat more about this!
DeepFake Detection and Red-Teaming - Tried building a startup in deepfake detection space and did market research around it while at EF. Did find some interest but eventually left it to pursue other things. You can find remnants of this work here.
LLM-Flexquant - tried building a small package to quantize LLM layers in any given configuration. Eventually learned that vLLM already does that in a very efficient manner(probably at the kernel level, while I was working on top of huggingface-transformers). Here is the repository of this work.
Reverse-Mark - Worked for a while on breaking and reverse engineering image watermarks. Started a project with a lab at UC Berkeley but left mid-way because of a lack of results in the research direction investigated. I got 6th position at the NeuRIPS 2024 Challenge Erasing the Invisible. Here is the repository of this work.
AI Agents for Geospatial Analysis - Used local LLMs to build AI assistants for GIS tasks. Here is the repository for this side-quest.
Layerwise Training Networks - Inspired by Geoffrey Hinton's forward-forward method, I explored the idea of training neural networks layer by layer, allowing for more granular control over the learning process and potentially bypassing the need for backpropagation.