60%
Reduction in bulk upload processing time
80%
Test coverage held across all services
TypeScript & Python
Production tech stack & Terraform orchestration
The Customer & Situation
Marriott operates enterprise-scale hospitality operations requiring high-throughput data operations and resilient backend services. As part of SimplifyVms enterprise talent and management integrations, their systems handle recurring, massive bulk data uploads across teams and third-party vendors.
The Problem
Bulk uploads were bottlenecked by single-threaded and legacy processing queues. High processing times restricted pipeline throughput, created delayed sync windows, and increased system strain during peak operational hours.
The architecture required modern multi-threaded execution, predictable error recovery, and robust test suites to prevent regressions without introducing downtime into live customer workflows.
What We Did
Moiz Nafey led the engineering effort to architect and implement a complete rewrite of the bulk upload processing pipeline:
- Architected a multi-threaded processing pipeline capable of parallel execution under heavy data loads.
- Implemented rigorous integration checks and automated testing, reaching and sustaining 80% test coverage across all affected services.
- Structured cloud infrastructure and microservices to allow predictable zero-downtime releases and resilient fault handling.
The Results
The multi-threaded rewrite reduced Marriott's bulk upload processing time by 60%. The system achieved consistent throughput during enterprise loads, providing immediate feedback loops to talent teams and vendor managers.
Comprehensive 80% test coverage ensured that future feature releases could be deployed rapidly without risking service stability or data integrity.