Nitin Bansal

Principal Software Engineer | Distributed Systems & Data Engineering Lead

LinkedIn | GitHub

About

Highly accomplished Principal Software Engineer with over 12 years of experience in architecting, building, and scaling distributed, data-intensive systems. Proven leader in driving complex technical initiatives end-to-end, mentoring high-performing engineering teams, and fostering cross-functional collaboration to deliver high-performance, reliable software solutions that process billions of events daily.

Work Experience

Principal Software Engineer

WebEngage

Apr 2022 - Nov 2024

Led critical software development initiatives from ideation to launch, driving cross-functional collaboration to deliver high-performance, scalable software systems.

  • Led full-lifecycle development of multiple high-impact projects, collaborating cross-functionally with PM, QA, CTO, and DevOps to ensure successful product launches.
  • Engineered and implemented robust CI/CD pipelines in collaboration with DevOps, significantly reducing release cycle time and accelerating time-to-market for new features.
  • Conducted an in-depth Proof of Concept and developed initial pipelines for migrating a 100+ TB BigQuery Warehouse to a self-hosted StarRocks environment, optimizing data infrastructure costs and performance.
  • Mentored and guided junior engineers on best practices in code quality, documentation, and architectural design, fostering team growth and enhancing overall technical proficiency.
  • Drove continuous delivery of system enhancements and maintained critical existing infrastructure, expertly managing parallel projects and coordinating team efforts to ensure operational excellence.

Senior Software Engineer

WebEngage

Mar 2013 - Apr 2022

Built and scaled multiple data-intensive services, processing billions of events daily to support key product features and system reliability.

  • Engineered an end-to-end event ingestion pipeline, processing over 5 billion events daily from Kafka to BigQuery for critical data analytics.
  • Developed a high-volume pipeline for updating over 800 million user profiles daily in BigQuery, ensuring real-time data consistency and availability.
  • Implemented real-time statistics processing for 5 billion events and 800 million profile updates daily, leveraging a Redis cluster to provide aggregated insights for business intelligence.
  • Built a conversion attribution service utilizing MongoDB, operating at a similar scale to process high volumes of user conversion data.
  • Developed a robust reporting service, generating over 800 daily reports with record counts exceeding hundreds of millions, enhancing data-driven decision-making.
  • Created a high-performance latest-event service using Cassandra, specifically designed to power the personalization engine.
  • Delivered multiple high-scale backend services that significantly improved key product features and overall system reliability.

Co-Founder

Apster Technologies Pvt. Ltd.

Sep 2011 - Aug 2012

Co-founded and bootstrapped a technology startup, successfully developing and launching two distinct software products for niche markets.

  • Spearheaded the development and launch of two bootstrapped products: a remote in-street ad management software and a 100% wireless tablet-based restaurant ordering & billing system.
  • Managed end-to-end product development, from concept to deployment, for both ventures, demonstrating full-stack technical leadership and market responsiveness.
  • Oversaw business operations and strategic direction, cultivating an agile development environment and driving early market penetration for innovative solutions.

Software Engineer (MMI)

Longcheer Technology India

Aug 2010 - Jul 2011

Developed and customized features for mobile platforms, enhancing functionality for major Chinese and Indian mobile brands.

  • Customized and developed specialized features for leading Chinese and Indian mobile brands on the MTK platform (plutommi & venus mmi), enhancing device functionality and user experience.

Embedded Software Developer

Emerson

Feb 2009 - Mar 2010

Developed embedded software for gas-chromatography systems, focusing on measurement flows, data storage, and sensor integration.

  • Developed critical measurement flows, robust data storage solutions, and UART communication protocols for a gas-chromatography system running on ARM Linux.
  • Designed and implemented ATMega-based sensor-board firmware, enabling on-field calibration and a user-friendly display interface for industrial applications.

Education

Embedded Systems

CDAC Pune

Jan 2008 - Dec 2009

Electrical, Electronics & Communications Engineering

MJPRU Bareilly

Jan 2004 - Dec 2008

Projects

Mock OpenAI Server

A NodeJS Express server that faithfully mimics OpenAI endpoints for cost-effective testing.

ZenQuery.app

A fully local desktop application (Electron) that provides instant answers on CSV, JSON, Excel, and Parquet data files using plain English. (Released)

Product Analytics SaaS

A SaaS platform designed to track events and user profiles, build funnels, cohorts, and journeys, analyze retention & conversion rates, and generate visual reports. (Work in Progress)

AI Journaling App

An application enabling text or voice entries with auto-generated topics & insights, plus natural-language search. (Planned)

DB Stress Bench

Customizable database load-testing tool providing real-time in-browser statistics. Supports multiple databases including MySQL, Postgres, SQLite, DuckDB, and Cassandra.

Blueprint

A zero-dependency Java-8 templating engine featuring 100% Nunjucks-compatible syntax.

Verdict & Verdict-Java

A library designed to evaluate conditions against data using MongoDB-like syntax (JavaScript & Java).

Guardian

A Java library offering robust solutions for retries, circuit breakers, and fallback strategies.

Skills

Languages

  • Java
  • Node.js
  • JavaScript
  • Python

Databases

  • BigQuery
  • Cassandra
  • MySQL
  • Redis
  • Elasticsearch
  • MongoDB
  • Postgres
  • SQLite
  • DuckDB

Messaging

  • Kafka

Infrastructure & DevOps

  • Kubernetes
  • Docker
  • AWS
  • GCP
  • CI/CD
  • GitLab
  • GitHub
  • ArgoCD

Project Management & Leadership

  • Technical Leadership
  • Cross-functional Collaboration
  • Mentoring
  • Product Development Lifecycle
  • Strategic Planning

System Design & Architecture

  • Distributed Systems
  • Data-Intensive Systems
  • Scalability
  • High-Performance Systems
  • System Reliability

Data Processing & Analytics

  • Real-time Data Processing
  • Event Ingestion
  • Data Warehousing
  • Reporting Services
  • Conversion Attribution