System architecture 1

System architecture is never one-size-fits-all. It adapts, evolves, and accumulates debt as companies grow. Whether you’re launching with a monolith, embracing microservices, or re-architecting from the ground up, each choice carries trade-offs. This article explores how companies across fintech, e-commerce, SaaS, gaming, and logistics encountered, managed, and mitigated architectural debt. Through these real-world stories, you'll gain insight into the system architecture strategies that enable long-term scalability and sustainability.

Fintech: Microservices from Day One – Strategic or Premature?

In 2015, Monzo launched its digital bank with a bold system architecture decision: adopting a microservices-first approach from day one. Their rationale was pragmatic - 24/7 banking services demand high availability, fault isolation, and operational flexibility from the beginning.

This decision aligned with non-functional requirements like scalability, resilience, and deployability. However, by 2024, Monzo’s architecture comprised over 2,800 microservices, surfacing an entirely new class of debt. 

 

Architectural Pain Points:

  • Excessive service fragmentation, leading to inter-service orchestration overhead
  • Version drift across services with inconsistent dependency management
  • High cognitive load for cross-cutting updates, e.g., security patches or shared concerns

 

Architectural Remediation:

  • Creation of a migration team to centralize repetitive platform updates
  • Internal development of mass-refactor tooling to support bulk edits and testing
  • Shift to a monorepo strategy to unify configuration and deployment processes

 

A well-justified microservice architecture can become a liability without strong platform support, dependency governance, and systemic refactoring mechanisms. 

System_architecture_ASSIST_Software_2

E-Commerce: Breaking the Monolith to Enable Agility

Amazon: SOA Before It Was Cool

Amazon’s early-2000 system architecture evolution began as they faced classic monolithic bottlenecks, tightly coupled components, shared state, and synchronized deployments.

 

Core Constraints:

  • Limited parallelism in development
  • Single point of failure at the database layer
  • Coupled deployment lifecycle, restricting release velocity

 

Their Transition:

  • Authored the Distributed Computing Manifesto
  • Adopted Service-Oriented Architecture (SOA)
  • Organized teams as two-pizza units, aligning Conway’s Law to service ownership

This facilitated bounded contexts, autonomous deployments, and domain-driven interfaces, setting the standard for large-scale SOA.

 

Zalando: Autonomy with Governance

Facing challenges in their monolithic system architecture, Zalando transitioned to microservices supported by engineering-wide alignment documents like their “Rules of Play.”

 

Applied Practices:

  • Enforced contract-first development and backward compatibility
  • Introduced a no shared libraries policy to decouple services
  • Adopted API versioning and documentation standards

 

Their success hinged on combining technical autonomy with organization-wide architectural conventions.

 

SaaS: Microservices vs. Modularity Trade-Off

Segment: Microservices for a Small Team

Segment’s system architecture was decomposed too early, creating more overhead than benefit. Their story highlights an architectural anti-pattern: the distributed monolith, where service boundaries exist in code but not in practice.

 

Challenges Faced:

  • Overhead in service-to-service reliability and integration testing
  • Redundant functionality and data duplication
  • Operational burden disproportionate to team size

Their course correction involved consolidating services into a modular monolith written in Go, restoring control, and improving reliability.

 

Khan Academy: Strategic Rewrite via Strangler Fig

With Python 2 deprecated, Khan Academy embarked on a system architecture rewrite using the Strangler Fig pattern:

  

  • Incrementally replaced monolith functionality
  • Built services in Go with clearly defined responsibilities
  • Froze legacy systems during migration to avoid regression

 

Their careful handling of architecture debt ensured continuity of service while improving long-term sustainability. 

System_architecture_ASSIST_Software_3

Gaming: Scaling Infrastructure to Match Global Load

Pixel Federation: Scaling Beyond the Legacy Stack

As user volume surged, Pixel Federation’s legacy system architecture revealed critical limitations:

  • Lack of elasticity under load  
  • Latency due to single-region deployment
  • Operational complexity from vertical scaling

 

Modernization Strategy:

  • Re-architected using microservices deployed on Kubernetes
  • Leveraged AWS services (e.g., DynamoDB, S3) for scalable persistence
  • Introduced multi-region deployment to reduce latency for global users

 

Riot Games: Platformization to Mitigate Service Sprawl

Riot Games invested in platform teams to proactively manage growing system architecture complexity and microservice sprawl.

 

Their approach included:

  • Creation of DevX (Developer Experience) paved the path to bootstrap services with preconfigured infrastructure
  • Adoption of service mesh (Istio) for consistent traffic policy and observability  
  • Standardization of telemetry, logging, and CI/CD practices

 

This minimized divergence and enabled scaling without compounding technical complexity. 

System_architecture_ASSIST_Software_4

Transportation & Delivery: Navigating Hypergrowth Architectures

Uber: From Monolith to Unbounded Mesh

Uber’s early system architecture began as a monolithic Python app, but rapidly evolved into a sprawling mesh of microservices.

 

This shift led to:  

  • Cascading failures due to weak fault boundaries  
  • Obscure service ownership and responsibility  
  • Prohibitive onboarding due to system complexity

 

Uber later introduced Domain-Oriented Microservice Architecture (DOMA) and adopted Apache Thrift to standardize APIs across services.

 

Additionally, investments in service discovery, distributed tracing (Jaeger), and observability became central to sustaining service reliability.

 

DoorDash: Controlled Consolidation

DoorDash learned key system architecture lessons from early microservices adoption, leading to a more consolidated and modular approach:

  • Poor service discoverability
  • Duplicate logic across domains
  • On-call burden due to inter-service dependencies

 

Their solution involved selectively merging microservices and prioritizing modular design over fine-grained service decomposition. They also invested in developer onboarding, internal service catalogs, and unified deployment processes to address structural and organizational complexity. 

Common Patterns, Symptoms, and Strategic Interventions

Recognizable Smells of System Architecture Debt:

  • All-hands deployments (monolith indicator)
  • Unclear service boundaries or ownership
  • Unpredictable runtime behavior due to coupling
  • Low testability or integration stability
  • High operational burden from fragmented tooling or inconsistent pipelines

 

Proven Patterns for Resolution:

  • Strangler Fig Pattern: Incremental rewrites of legacy systems
  • Circuit Breakers & Bulkheads: Resilience patterns to isolate failures
  • Macroservices: A compromise between monoliths and microservices
  • Paved Path/Golden Path Platforms: Promote consistent service scaffolding
  • ADRs (Architecture Decision Records): Create traceability for evolution
  • Service Catalogs and Dependency Mapping: Improve visibility and team alignment

 

Principles to Internalize:

  • System architecture must evolve as team topology, scale, and velocity change
  • Debt is inevitable, but it must be intentional, monitored, and managed
  • Effective architecture couples organizational design and infrastructure investment 
System_architecture_ASSIST_Software_5

Architecture as a Living System

A system architecture is never static. The answer is almost always in the architectural design world: it depends. Every decision, whether it's introducing a new architectural layer, breaking apart a monolith, or consolidating services, needs to be evaluated based on product maturity, team structure, and engineering constraints. Success usually involves making deliberate, contextual trade-offs (not following trends or checklists).

 

Effective architecture teams:

  • Monitor system health with metrics like deployment frequency, MTTR, and team-to-team dependency load
  • Invest in platform capabilities to reduce fragmentation and increase consistency
  • Build lightweight governance into delivery workflows, including feedback loops, system architecture reviews, and design documentation.

 

System architecture work isn’t a one-time design exercise. It’s ongoing maintenance. Managing architectural debt means making time to clean up as you grow, or risking that growth getting stuck under its weight.

 

Sources include engineering retrospectives and technical blogs from Monzo, Amazon, Uber, Segment, Khan Academy, Zalando, Riot Games, DoorDash, and others. These cases provide critical insight into how architecture evolves in production and what it takes to keep it healthy at scale.

 

[1]  https://monzo.com/blog/how-we-run-migrations-across-2800-microservices

[2] https://www.allthingsdistributed.com/2019/08/modern-applications-at-aws.html

[3] https://www.uber.com/blog/service-oriented-architecture

[4] https://segment.com/blog/goodbye-microservices  

[5] https://blog.khanacademy.org/beating-the-odds-khan-academys-successful-monolith%E2%86%92services-rewrite

[6] https://vfunction.com/blog/application-modernization-case-study

[7] https://www.infoq.com/news/2016/02/Monolith-Microservices-Zalando

[8] https://www.allthingsdistributed.com/2022/11/amazon-1998-distributed-computing-manifesto.html 

Share on:

I have read and understood the ASSIST Software website's Terms of Use and Privacy Policy.

Want to stay on top of everything?

Get updates on industry developments and the software solutions we can now create for a smooth digital transformation.

Frequently Asked Questions

1. Can you integrate AI into an existing software product?

Absolutely. Our team can assess your current system and recommend how artificial intelligence features, such as automation, recommendation engines, or predictive analytics, can be integrated effectively. Whether it's enhancing user experience or streamlining operations, we ensure AI is added where it delivers real value without disrupting your core functionality.

2. What types of AI projects has ASSIST Software delivered?

We’ve developed AI solutions across industries, from natural language processing in customer support platforms to computer vision in manufacturing and agriculture. Our expertise spans recommendation systems, intelligent automation, predictive analytics, and custom machine learning models tailored to specific business needs.

3. What is ASSIST Software's development process?  

The Software Development Life Cycle (SDLC) we employ defines the stages for a software project. Our SDLC phases include planning, requirement gathering, product design, development, testing, deployment, and maintenance.

4. What software development methodology does ASSIST Software use?  

ASSIST Software primarily leverages Agile principles for flexibility and adaptability. This means we break down projects into smaller, manageable sprints, allowing continuous feedback and iteration throughout the development cycle. We also incorporate elements from other methodologies to increase efficiency as needed. For example, we use Scrum for project roles and collaboration, and Kanban boards to see workflow and manage tasks. As per the Waterfall approach, we emphasize precise planning and documentation during the initial stages.

5. I'm considering a custom application. Should I focus on a desktop, mobile or web app?  

We can offer software consultancy services to determine the type of software you need based on your specific requirements. Please explore what type of app development would suit your custom build product.   

  • A web application runs on a web browser and is accessible from any device with an internet connection. (e.g., online store, social media platform)   
  • Mobile app developers design applications mainly for smartphones and tablets, such as games and productivity tools. However, they can be extended to other devices, such as smartwatches.    
  • Desktop applications are installed directly on a computer (e.g., photo editing software, word processors).   
  • Enterprise software manages complex business functions within an organization (e.g., Customer Relationship Management (CRM), Enterprise Resource Planning (ERP)).

6. My software product is complex. Are you familiar with the Scaled Agile methodology?

We have been in the software engineering industry for 30 years. During this time, we have worked on bespoke software that needed creative thinking, innovation, and customized solutions. 

Scaled Agile refers to frameworks and practices that help large organizations adopt Agile methodologies. Traditional Agile is designed for small, self-organizing teams. Scaled Agile addresses the challenges of implementing Agile across multiple teams working on complex projects.  

SAFe provides a structured approach for aligning teams, coordinating work, and delivering value at scale. It focuses on collaboration, communication, and continuous delivery for optimal custom software development services. 

7. How do I choose the best collaboration model with ASSIST Software?  

We offer flexible models. Think about your project and see which model would be right for you.   

  • Dedicated Team: Ideal for complex, long-term projects requiring high continuity and collaboration.   
  • Team Augmentation: Perfect for short-term projects or existing teams needing additional expertise.   
  • Project-Based Model: Best for well-defined projects with clear deliverables and a fixed budget.   

Contact us to discuss the advantages and disadvantages of each model. 

1. Is ASSIST Software a reliable company for custom engineering?

Absolutely. Our partners have given us great recommendations and reviews, leading us to win The Manifest Award for Most Reviewed Software Developers. Further proof comes from our 97% employee retention rate and ongoing client partnerships for over 8 years.  

2. Are the ASSIST Software Romanian software engineers certified?

Yes. 85% of our software programmers are certified.  

At a company level, ASSIST Software is certified and recognized by industry players such as Microsoft, AWS, Google Cloud, Adobe, Drupal, Fujitsu, ISTQB, and others.  

Our employee certifications are tremendously important as they reflect the shared commitment to long-term growth.

3. Why should I choose Romania for custom software development? 

Romania has become a significant player in custom software development, attracting businesses worldwide. Romania boasts the highest number of certified IT specialists in Europe and ranks sixth globally, surpassing even the US in tech specialists per capita.  

At ASSIST Software, what sets us apart is our team and our location: our engineers are certified, experienced, and flexible, while being in the +2 GMT time zone allows us to easily facilitate meetings with clients all over the world.

4. What team will work on my project, and where will it be located?

ASSIST Software's headquarters is in Romania, a prime country for software development outsourcing. Our 350+ software engineers speak English and have a deep passion for innovation.  

We provide regular project updates through reports, meetings, and online dashboards. Generally, you'll have access to a dedicated project manager who will be your point of contact for any questions or concerns.  

5. How much will my project cost me?

Our prices are competitive, and as per our working model, we guarantee you will be satisfied with the result. Frequent meetings, check-ins, and a great communication structure will ensure this outcome.   

Project costs depend on various factors, including complexity, scope, required technologies, and team size. We'll gather detailed information about your project during the initial consultation to provide a customized quote and we guarantee that you will be able to see the benefits of bespoke software.  

1. What technologies do you work with?

ASSIST Software tackles your projects with a robust tech stack. We build native and cross-platform mobile apps, craft user-friendly web experiences, and create stunning visuals. 

Our wide-ranging expertise starts from Java, Python, and JavaScript frameworks to cutting-edge solutions like AR/VR, blockchain, and AI/ML. We also manage databases, leverage cloud platforms, and ensure flawless project execution. We're your one-stop shop for exceptional software development from concept to deployment. You can view our expertise for more details.   

2. Are you experienced in AI/ML development?

Yes. We have extensive experience in data engineering and machine learning operations (MLOps). We can employ neural networks, computer vision, and AI models to benefit your ideas.   

You can trust our long-term experience with big data, NLP, and sentiment analysis, as over the past three years, we led a European security project with 15 partners focused on detecting radicalization on social media and the dark web.

3. Do you have a research and development department and work on European Projects?

We know R&D is crucial for businesses to stay competitive and thrive in dynamic markets. Successful R&D efforts lead to developing exceptional products or services, improved efficiency and effectiveness in operations, and enhanced market positioning.   

We have established solid partnerships with 160+ European research companies, universities, and research centers (e.g., Fraunhofer, TWI, University of Heidelberg, REWE Group, SINTEF, etc.) and have participated as technical partners in over 25 EU-funded projects.  

4. Besides custom software solutions, what other services do you offer?

  • Design Thinking for Breakthrough Products:  

    We craft user experiences that resonate. Our design process is an immersive collaboration, starting with workshops to uncover your vision and user needs. We conduct market research, analyze the competition, and guide you toward cutting-edge solutions in accordance with your business requirements.  

  • Digital Transformation to Reimagine Your Business:

    Digital transformation is nothing less than a strategic shift. We empower you to become more agile and data-driven, optimizing core processes for the digital age.  

  • Scale with Confidence as We Build for Growth:  

    We understand that business success and development mean new challenges. Our solutions are built to scale seamlessly, accommodating increasing user bases and data volumes without sacrificing performance or security.  

5. As a company, does ASSIST have its own software products?

Yes, ASSIST Software teams have been involved in designing and developing innovative products that address community needs. One such example is the web and mobile platform Autisma. This therapy assistant enables continued learning for children diagnosed with autism spectrum disorder.   

Our extensive knowledge of the Unity and Unreal engines has allowed us to develop two mobile games, Elly and the Ruby Atlas and Hooman Invaders, as well as various Unity Assets, such as the Real-Time Weather PRO and Easy Sky. These two Unity assets allow Unity developers to control the weather and sky in their projects.   

1. Is ASSIST Software hiring right now?

We are always looking for great people to join our team, whether you're a senior software engineer or a new talent seeking an IT career. Please check our careers page and contact us. Our HR department will contact you as soon as possible.   

2. Is ASSIST Software organizing internships?

Yes. Each year, we organize individual and group internships for students. Our long-term partnership with the Stefan cel Mare University of Suceava allows us to put together great events for students and help them get started in the industry. 

3. What type of learning culture does ASSIST Software encourage?

Our focus on innovation comes from a 'can do' attitude and the continuous learning we encourage our colleagues to pursue. We frequently organize workshops, learning sessions, presentations, and masterclasses. All these events are free and open to our colleagues and aim to support their professional and personal development. 

4. How does ASSIST Software focus on teamwork?

The key to stellar teamwork is the quality time we spend together. ASSIST employees and their families are frequently invited to participate in all activities. We encourage a healthy lifestyle by promoting and organizing hikes, bike riding sessions, marathons, volleyball, football and tennis matches, ping-pong championships, and many more.   

We show our care for the environment through reforestation campaigns and forest cleaning activities.   

We also have an English-speaking club, e-sports gaming nights, tech discussions, networking parties, and board game sessions.   

5. How does ASSIST Software give back to the community?

Volunteering and charity are essential to us, which is why we founded the ASSIST Humanitarian Foundation. We genuinely care about our community and want to improve the future. We invest in IT equipment for schools and award excellent teachers. We also help hospitals and fire departments enter the 21st century.   

We sponsor cultural events and deliver humanitarian aid to those in need. If you agree with our views, you can also donate.   

ASSIST Software Team Members