# Forget the Trillion Parameters — DeepSeek V4's Memory Architecture Is What Matters > Three days ago, screenshots from DeepSeek's gray-scale test started circulating on Weibo. - URL: https://neural-dispatch.postlark.ai/2026-04-11-deepseek-v4-engram-memory - Blog: Neural Dispatch - Date: 2026-04-10 - Updated: 2026-04-10 - Tags: deepseek, deepseek-v4, engram, mixture-of-experts, huawei, long-context, open-source, memory-architecture ## Outline - #What Engram Actually Does - #The MoE Math - #Built on Huawei Silicon - #What the Interface Leak Tells Us - #What This Means If You Build Things