Arpit Kumar
*just vibes* vision models → late nights zzz ✦ 3D motion ✦ training epochs... still optimizing
✦
★
✦
★
✦
✸

ABOUT

ME

I’m a Computer Science engineer focused on ✦ AI, computer vision, and intelligent interactive systems.

I enjoy taking problems that sit somewhere between research and real-world use and turning them into things people can actually interact with. My work has ranged from computer vision and markerless motion capture to multimodal AI, OCR, and vision-language models—often involving the full journey from dataset preparation and model training to the final product.

What interests me most is the space where ✦ AI meets creativity and human interaction. I like building systems that don't just demonstrate a model, but give that model a purpose—whether that's making reading more accessible, reducing the cost of motion capture, or exploring new ways for people to interact with technology.

EDUCATION

B.Tech CSE (AI & ML) · IMS Engineering College

2022 – 2026 · CGPA 7.04/10

Online BS in Data Science & Applications · IIT Madras

Currently Pursuing Online · Diploma Level

CREATIVE ENGINEERING
  • 3D MOTION SYNTHESIS
  • INTERACTIVE WEBGL
  • KINETIC RIGGING
  • COMPUTER VISION
  • CREATIVE TOOLING
PATENTS & RESEARCH
  • Patent Publication: "A Virtual Body Augmented with AI Assistant" (Application No: 202211074491).
  • Published Paper: Scopus IEEE Xplore NMIC 2026 — Synapse Assistive System
  • British Council English C1 Advanced (577/600)
  • Workshops at IIT Bombay (AI/ML at TechFest 2022) & IIT BHU - Technex (Python training - 4 weeks)
FEATURED PROJECT
Live MoCap

VidVision3D

Markerless 3D Motion Capture & Kinematics Studio

Client-side motion capture platform converting monocular webcam feeds into animatable 3D skeletal armatures (.BVH export for Blender/Unity) & 2D puppet rigs with zero cloud latency.

Three.js BlazePose MediaPipe BVH Export React

FEATURED

PROJECTS

Markerless 3D motion capture, assistive eye tracking, production flight platforms, multimodal emotion AI, and Vision-Language models.

VidVision3D
3D MoCap · Three.js

VidVision3D

Hero • 3D MoCap & Kinematics

Problem: Traditional MoCap demands multi-camera optical studios and costly sensor suits.
System: Client-side platform converting monocular webcam feeds into animatable 3D skeletal armatures (.BVH export for Blender/Unity) & 2D puppet rigs.
Contribution & Result: Built real-time BlazePose-to-Three.js kinematic retargeting and mathematical BVH joint serializer—cutting 3D animation turnaround and costs by 80% with zero cloud dependencies.

Three.js BlazePose MediaPipe BVH Export React Kinematics
Synapse AI
0.9989 AUC Gaze Model

Synapse

IEEE Xplore Scopus 2026

Problem: Assistive reading tools fail to detect real-time cognitive difficulty and reading fatigue in neurodivergent users.
System: Privacy-first, browser-native assistive platform fusing gaze tracking with adaptive typographic scaffolding and TTS.
Contribution & Result: Engineered the MediaPipe iris tracking pipeline, extracted behavioral gaze features from the ZuCo benchmark, and trained an XGBoost classifier achieving 0.9989 AUC for cognitive difficulty prediction.

Eye Tracking XGBoost IEEE Xplore MediaPipe ZuCo Benchmark React
SkyBook
DEL✈BOM
Flights · Seat Matrix

SkyBook — Airline Booking & Fleet Platform

Production Systems • Full-Stack

Problem: Airline booking platforms demand robust concurrent seating, instant ticketing, and granular fleet administration.
System: High-performance full-stack flight operations platform with live route search, seat matrix allocation, and ticketing workflows.
Contribution & Result: Designed end-to-end REST APIs, client transactional state management, dynamic aircraft cabin matrices, and automated PDF boarding pass generation.

React Node.js Vite REST APIs TailwindCSS
Smart Tracker
⏱️ Slots 🔥 Cal 💰 Ledger
Android · Compose M3

Smart Tracker

Android • Kotlin & Jetpack Compose

Problem: Fragmented apps for routines, nutrition, and finance compromise user privacy with unencrypted cloud tracking.
System: Local-first Android suite with automated schedule duration splitting, calorie & hydration logging, and double-entry accounting.
Contribution & Result: Architected Clean Architecture MVVM layers, reactive Jetpack Compose UI, and zero-leak offline persistence via encrypted Room SQLite.

Kotlin Jetpack Compose Room SQLite Android Local-First
Emotion AI
Voice + Vision + NLP

Multimodal Emotion Recognition

Deep Learning • Audio / Vision / NLP

Problem: Unimodal sentiment models fail when interpreting subtle sarcasm, voice inflections, or mixed facial expressions.
System: Low-latency GPU inference pipeline fusing acoustic pitch, facial action units, and semantic textual embeddings.
Contribution & Result: Trained CNNs on RAVDESS with Librosa MFCC acoustic extraction on TensorFlow/CUDA, fusing Wav2Vec2, DeepFace, and Transformers for robust multimodal inference.

Deep Learning Wav2Vec2 TensorFlow

TECHNICAL

SKILLS

Structured across core AI/CV depth, production engineering systems, and frontier research exploration.

Core AI & Computer Vision

Python Computer Vision (OpenCV) MediaPipe & BlazePose PyTorch & TensorFlow Deep Learning 3D Kinematics & MoCap XGBoost ML Pipeline Architecture

Production Systems & Engineering

React & TypeScript Android (Kotlin · Jetpack Compose) FastAPI & Node.js Three.js & WebGL Room SQLite & PostgreSQL REST APIs & State Management Docker & Git

Research, VLMs & Cloud GPUs

VLMs (LayoutLMv3, Qwen) Cloud GPUs (CUDA, RunPod.io) CVAT Dataset Annotation Multimodal Audio/Vision Fusion ZuCo Gaze Benchmarks LLM Fine-tuning

WORK

EXPERIENCE

Track record across AI enterprise solutions, published Scopus research, patent inventions, and hackathons.

Engineer — Full Stack Developer

Coforge Ltd. — Greater Noida

Full-Time May 2026 – Present
  • › Joined in May 2026; completed intensive engineering training in September 2026 and transitioned to full-time Engineer.
  • › Architecting, developing, and maintaining high-performance full-stack web applications using React, Node.js, Express, and RESTful APIs.
  • › Implementing scalable database models (MySQL, MongoDB, PostgreSQL) and driving code quality standards within Agile/Scrum sprint workflows.
Full-Time React Node.js Express REST APIs MySQL MongoDB Agile / Git

AI/LLM Solutions Developer

Botter Solutions Pvt. Ltd. — Rovabot.io

Internship Aug 2025 – Nov 2025
  • › Researched OCR and classification models; fine-tuned, trained, and tested LLMs, VLMs, and vLLMs including LayoutLMV3, QWEN3, CascadeTabNet, TableLLM, and PaddleOCR-VL.
  • › Managed dataset preparation and high-quality annotations using CVAT.
  • › Utilized cloud GPUs on RunPod.io and handled cloud resource management and workflow formulation.
LayoutLMV3 QWEN3 vLLM RunPod.io CVAT

Data Annotation Specialist & ML Assistant

DrafTineAI — Draftine.com

Freelance Feb 2026 – Apr 2026
  • › Annotated complex architectural diagrams on CVAT; interpreted ambiguous visual inputs and maintained strict labeling consistency.
  • › Assisted in research and model training using Detectron2 and YOLOv8x.
  • › Analyzed visual and contextual data to identify inconsistencies and optimize dataset structure for training.
Detectron2 YOLOv8x CVAT Computer Vision

Published Author & Researcher (Synapse)

Scopus IEEE Xplore NMIC 2026

Publication 2026
  • › Co-authored "Synapse: A Multimodal Assistive Reading System with Cognitive Difficulty Prediction".
  • › Engineered serverless attention tracking via MediaPipe and trained XGBoost on the ZuCo dataset (0.9989 AUC via behavioral gaze features).
IEEE Xplore ZuCo Dataset XGBoost Eye Tracking

Patent Inventor

Indian Patent Office

Patent App No: 202211074491
  • › Invented "A Virtual Body Augmented with AI Assistant" — bridging 3D avatars, contextual AI agents, and sensory input.
Patent 3D Avatar AI Assistant Sensory AI

GET IN

TOUCH

Always open to discussing Computer Vision pipelines, 3D interactive graphics, and deep learning research collaborations.

Open for Opportunities
View Resume / CV PDF ↗

Available for AI & Computer Vision engineering roles, 3D interactive graphics, research collaborations, and ambitious builds. Feel free to reach out directly.

⚡ DIRECT TRANSMISSION

Let's Connect

Direct to inbox · Instant delivery

Send a message directly to my email without needing an email app:

or reach out via channels