LLMOps Architecture: End-to-End Streaming, QLoRA Tuning, and Serving
A technical source audit analyzing LLMOps production architecture: streaming ingestion, parameter-efficient QLoRA fine-tuning, and low-latency inference.
Fodev JEO
LATEST INVESTIGATIONS
Source audits & field notes
LLM2Vec, Two Years On: The Thesis Won, the Recipe Did Not
The paper claimed unsupervised MTEB SOTA as of May 2024 and put itself 6th overall. This page dropped every qualifier. What the download numbers say now.
Meta Llama 3.1 Architecture: 405B Scaling, 4D Parallelism, and DPO Alignment
An architectural source audit of Meta’s Llama 3.1 405B report, evaluating 4D distributed parallelism, 128K context scaling, and DPO post-training alignment.
The Architecture of Agentic Data Analysts: CodeAct and Execution Sandboxes
A source audit analyzing autonomous agentic data analysts, comparing CodeAct Python execution, JSON tool calling, sandboxed kernels, and dynamic visualization.
Architectural Foundations of LLM Agents: Profile, Memory, Planning, and Action
A source audit evaluating autonomous LLM agent architectures, analyzing the four foundational modules—profile, memory, planning, and action—and agentic evaluation.
UDP Architecture and Systems Engineering: Low Latency Transport Protocols
An architectural audit of User Datagram Protocol, detailing 8-byte minimal headers, QUIC HTTP/3 multiplexing, market data multicast, and RoCEv2 AI clusters.
Llama 3.1 Architecture: Dense Scaling to 405B and 128K Context
An architectural audit of Meta Llama 3.1, analyzing dense 405B parameter scaling, 128K context expansion via RoPE, FP8 quantization, and iterative post-training.
Visualizing RAG Embeddings: Exploratory Data Analysis and Vector Space Diagnostics
A source audit evaluating exploratory data analysis for RAG systems, analyzing UMAP projections, embedding cluster diagnostics, and failure mode identification.
A Systematic Taxonomy of Prompt Engineering: From Zero-Shot to Tree of Thoughts
A source audit analyzing prompt engineering literature, evaluating Zero-Shot, Chain-of-Thought, Tree-of-Thoughts, Self-Consistency, and Multimodal taxonomies.
Deconstructing Microservices: Bounded Contexts, Distributed Sagas, and Event Sourcing
A source audit analyzing microservices architecture, evaluating Domain-Driven Design boundaries, distributed Saga transactions, and event-driven choreography.
인기 태그
Search article titles, categories, and tags. Full text is searched when needed.
Type to search articles.