Tag: Architecture

  • Mixture-of-Experts explained: why the biggest models are mostly idle

    Imagine an AI model with one trillion parameters , but only 32 billion of them participate in processing any particular token. The remaining 968 billion parameters are effectively sitting out that com

  • Best practices: scalable architectures for data systems

    Scalable data architectures in 2025 demand more than adding servers—they require modularity, elasticity, and deep observability. This guide breaks down modern best practices, from event-driven designs and data mesh to storage-compute decoupling and AI-native architectures, with real-world case studies from Netflix, Uber, and Spotify.

  • Empirical: throughput comparison of streaming architectures

    This empirical analysis benchmarks the throughput of modern streaming architectures, comparing Apache Kafka, Apache Pulsar, Redpanda, and Flink-based pipelines. Using standardized workloads and realistic latency constraints, we dissect their design trade-offs, operational costs, and observed performance under varied load conditions.

  • Topics Everyone Is Talking About No248

    Advent of Code 2025 Begins with a Competitive Twist • Hacking on the reMarkable 2 • You Want Microservices But Do You Need Them?