IEEE

3D-CIMlet: A Chiplet Co-Design Framework for Heterogeneous In-Memory Acceleration of Edge LLM Inference and Continual Learning

Abstract: The design space for edge AI hardware supporting large language model (LLM) inference and continual learning is underexplored. We present 3D-CIMlet, a thermal-aware modeling and co-design ...
GitHub

Threading the Maze of Lifelong Memory for LLM Agents

AriadneMem is a structured memory system that addresses disconnected evidence and state update challenges in long-horizon LLM agents through a decoupled two-phase pipeline.
marktechpost

How to Build a Production-Grade Agentic AI System with Hybrid Retrieval, Provenance-First Citations, Repair Loops, and Episodic Memory

In this tutorial, we build an ultra-advanced agentic AI workflow that behaves like a production-grade research and reasoning system rather than a single prompt call. We ingest real web sources ...
GitHub

Distributed AI Memory System with Redis Cluster + MCP + Local LLM Inference

┌──────────────────────────────────────────────────────� ...
IEEE

LLM-on-the-Palm: Mobile LLM Inference with PIM-Enhanced NAND Flash Memory

Abstract: Large Language Model (LLM) inference on edge devices is crucial for democratizing AI and addressing privacy and security concerns associated with cloud services. However, the large parameter ...