{"id":35035,"date":"2025-07-08T18:03:28","date_gmt":"2025-07-08T18:03:28","guid":{"rendered":"https:\/\/www.duck9.com\/blog\/?p=35035"},"modified":"2025-07-08T14:03:53","modified_gmt":"2025-07-08T18:03:53","slug":"peter-voss-third-wave-ai-and-how-exactly-wave-2-ai-falls-short-due-to-token-limitations","status":"publish","type":"post","link":"https:\/\/www.duck9.com\/blog\/peter-voss-third-wave-ai-and-how-exactly-wave-2-ai-falls-short-due-to-token-limitations\/","title":{"rendered":"Peter Voss\u2019 Third Wave AI and How Exactly Wave 2 AI Falls Short Due To Token Limitations"},"content":{"rendered":"
\n
\n
<\/p>\n\n\n\n\n
 <\/td>\n<\/tr>\n
 <\/td>\n\n\n\n\n
<\/a><\/td>\n<\/td>\n\n\n\n\n\n\n\n\n\n\n
Larry Chiang, 650-283-8008<\/a><\/b><\/td>\n<\/tr>\n
\u2066\u202a@LarryChiang\u202c\u2069<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/td>\n<\/td>\n<\/tr>\n
<\/td>\n<\/tr>\n
Walk me through Peter Voss\u2019 third wave ai and how exactly wave 2 ai falls short due to token limitations<\/td>\n<\/tr>\n
 <\/td>\n<\/tr>\n
7\/8\/25, 12:59\u202fPM<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/td>\n <\/td>\n<\/tr>\n
 <\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

<\/a><\/p>\n

<\/div>\n
### Key Points<\/div>\n
– Research suggests Peter Voss\u2019s third wave AI focuses on cognitive architectures mimicking human intelligence, aiming for Artificial General Intelligence (AGI) with systems that integrate memory, reasoning, and metacognition.<\/div>\n
– It seems likely that second-wave AI, like GPT-3 and GPT-4, is limited by token constraints, restricting context handling and real-time adaptability.<\/div>\n
– The evidence leans toward third-wave AI overcoming these limitations through graph-based knowledge representation, enabling flexible, long-term interactions.<\/div>\n
<\/div>\n
<\/div>\n
### Peter Voss\u2019s Third Wave of AI<\/div>\n
Peter Voss, a noted AI pioneer, describes the third wave of AI as Cognitive AI, which seeks to emulate human intelligence through cognitive architectures. These systems aim for Artificial General Intelligence (AGI) by integrating components like short-term memory, long-term memory, goals, context, metacognition, and reasoning. A key feature is the use of a super high-performance graph database, reportedly 1000 times faster than commercial graph databases, enabling real-time, autonomous learning even with incomplete data. This approach is detailed in various articles, such as [Peter Voss – The Third Wave of AI](www.linkedin.com\/pulse\/third-wave-ai-peter-voss<\/a>) and [Cognitive AI – by Peter Voss](petervoss.substack.com\/p\/cognitive-ai<\/a>).<\/div>\n
<\/div>\n
### Limitations of Second-Wave AI Due to Token Constraints<\/div>\n
Second-wave AI, dominated by Deep Learning models like GPT-3 and GPT-4, processes data in tokens, with fixed context windows (e.g., 2048 tokens for GPT-3, 8192 for GPT-4). These token limitations restrict the models\u2019 ability to handle long conversations or complex tasks, requiring workarounds like splitting inputs or summarizing, which can lose context. They also struggle with real-time updates and abstract reasoning, often leading to hallucinations. This is supported by resources like [Understanding Token Limits in Modern AI Models](medium.com\/@t.sankar85\/understanding-output-token-limits-in-modern-ai-models-99f6db54c7c6<\/a><\/a>) and [What are tokens and how to count them? | OpenAI Help Center](help.openai.com\/en\/articles\/4936856-what-are-tokens-and-how-to-count-them<\/a>).<\/div>\n
<\/div>\n
### How Third-Wave AI Addresses These Limitations<\/div>\n
Third-wave AI overcomes token limitations by using a graph-based knowledge representation instead of fixed token sequences. This allows for flexible, efficient handling of large, dynamic contexts, enabling systems to reason over extensive datasets and maintain coherence in long-term interactions, addressing the shortcomings of second-wave AI.<\/div>\n
<\/div>\n
<\/div>\n
\"image0.png\"\"image1.png\"<\/div>\n
### Detailed Survey Note: Exploring Peter Voss\u2019s Third Wave AI and Second-Wave AI\u2019s Token Limitations<\/div>\n
<\/div>\n
This note provides a comprehensive analysis of Peter Voss\u2019s concept of the third wave of AI, focusing on its characteristics and how it addresses the limitations of second-wave AI, particularly due to token constraints. The discussion is informed by recent online resources and aligns with the current understanding as of July 8, 2025.<\/div>\n
<\/div>\n
#### Background on Peter Voss and AI Waves<\/div>\n
Peter Voss, a serial entrepreneur and AI pioneer, has extensively written about the evolution of AI, categorizing it into three waves. His work, accessible through platforms like LinkedIn and Medium, positions him as a key figure in advancing Artificial General Intelligence (AGI). The first wave involved rule-based, symbolic AI, effective for specific tasks but lacking adaptability. The second wave, dominated by Deep Learning and statistical models, marked significant progress in natural language processing and image generation, exemplified by models like GPT-3 and GPT-4. However, Voss argues that the third wave, Cognitive AI, represents a paradigm shift toward systems that mimic human cognitive processes, aiming for AGI.<\/div>\n
<\/div>\n
#### Characteristics of Third-Wave AI<\/div>\n
Voss\u2019s third-wave AI, or Cognitive AI, is characterized by cognitive architectures designed to emulate human intelligence. These architectures integrate various cognitive components, as outlined in his Substack post [Cognitive AI – by Peter Voss](petervoss.substack.com\/p\/cognitive-ai<\/a>):<\/div>\n
– **Short-term memory (STM)** and **long-term memory (LTM)** for storing and retrieving information.<\/div>\n
– **Goals** and **context** to guide behavior and decision-making.<\/div>\n
– **Metacognition** (self-awareness) and **reasoning** for higher-level, System 2 thinking, as defined in [System 2 Thinking](en.wikipedia.org\/wiki\/Thinking,_Fast_and_Slow<\/a>).<\/div>\n
<\/div>\n
A critical technological enabler is the use of a **super high-performance graph database**, claimed to be 1000 times faster than the best commercial graph databases, detailed in a whitepaper at [https:\/\/arxiv.org\/pdf\/2309.01622.pdf]. This database supports real-time, autonomous, goal-directed learning, even with incomplete or contradictory data, as noted in the same post. This integration is intended to enable systems to handle complex, long-term tasks, addressing limitations of previous waves.<\/div>\n
<\/div>\n
Voss\u2019s vision, as discussed in [Peter Voss – The Third Wave of AI](www.linkedin.com\/pulse\/third-wave-ai-peter-voss<\/a>), emphasizes that third-wave AI can tackle global challenges like disease, poverty, and environmental issues, suggesting a broader application scope compared to earlier waves.<\/div>\n
<\/div>\n
#### Second-Wave AI and Token Limitations<\/div>\n
Second-wave AI, primarily Deep Learning models, relies on transformer architectures and statistical methods, processing data in units called tokens. Tokens are chunks of words or characters, and models like GPT-3 (2048 tokens) and GPT-4 (8192 tokens) have fixed context windows, as explained in [What are tokens and how to count them? | OpenAI Help Center](help.openai.com\/en\/articles\/4936856-what-are-tokens-and-how-to-count-them<\/a>). These limitations create several challenges:<\/div>\n
<\/div>\n
– **Limited Context Handling**: The fixed token limit restricts the amount of information processed in a single interaction. For tasks requiring long conversations or extensive documents, models must split inputs, potentially losing context, as noted in [Understanding Token Limits, Pricing, and When to Use Large Context Models](medium.com\/@hernanimax\/understanding-token-limits-pricing-and-when-to-use-large-context-models-0dcb06e724d2<\/a><\/a>).<\/div>\n
– **Inefficiency in Real-Time Interaction**: These models cannot dynamically update their core knowledge in real-time, requiring retraining or fine-tuning, which is resource-intensive. This is highlighted in discussions on enterprise LLM inference, such as [Tokens Per Second is Not All You Need](sambanova.ai\/blog\/tokens-per-second-is-not-all-you-need<\/a>).<\/div>\n
– **Hallucination and Reasoning Issues**: Due to their statistical nature, second-wave models often generate incorrect information (hallucinations) and struggle with abstract reasoning and planning, as mentioned in Voss\u2019s Substack post. This is a consensus in the field, as seen in [3 Strategies to Overcome OpenAI Token Limits](www.bretcameron.com\/blog\/three-strategies-to-overcome-open-ai-token-limits<\/a>).<\/div>\n
– **Resource Intensity**: The need for massive data and computational power, as discussed in [Explaining Tokens \u2014 the Language and Currency of AI](blogs.nvidia.com\/blog\/ai-tokens-explained\/<\/a>), limits scalability and practicality for real-world applications.<\/div>\n
<\/div>\n
These limitations are evident in practical scenarios, such as AI transcription tools (e.g., [The Best AI Transcription & Summarization Powered By GPT-4 & GPT-4o](www.supernormal.com\/blog\/free-gpt4-meeting-transcription)<\/a>), where token limits necessitate workarounds like breaking text into smaller pieces.<\/div>\n
<\/div>\n
#### Comparative Analysis: How Third-Wave AI Overcomes Token Limitations<\/div>\n
Voss\u2019s third-wave AI addresses these token-related shortcomings through its cognitive architecture and graph-based knowledge representation. The Substack post [Cognitive AI – by Peter Voss](petervoss.substack.com\/p\/cognitive-ai<\/a>) details that, unlike second-wave AI\u2019s token-based processing, third-wave AI uses a flexible system that integrates all cognitive components seamlessly. The graph database, far faster than commercial alternatives, enables:<\/div>\n
– **Flexible Context Handling**: Instead of fixed token sequences, the system can reason over large, dynamic datasets, maintaining coherence across long-term interactions.<\/div>\n
– **Real-Time Adaptability**: The architecture supports autonomous, goal-directed learning in real-time, addressing the second-wave\u2019s inability to update incrementally, as noted in the post.<\/div>\n
– **Enhanced Reasoning**: By integrating metacognition and reasoning, third-wave AI can handle abstract tasks and explain actions, reducing hallucination risks.<\/div>\n
<\/div>\n
This is supported by comparisons in Voss\u2019s articles, such as [Why Machine Learning won\u2019t cut it](medium.com\/@petervoss\/why-machine-learning-wont-cut-it-f523dd2b20e3<\/a><\/a>), which highlight second-wave AI\u2019s poor performance in language comprehension and reasoning compared to the third wave\u2019s capabilities.<\/div>\n
<\/div>\n
#### Supporting Evidence and References<\/div>\n
The discussion is informed by multiple sources, including:<\/div>\n
– DARPA\u2019s Three Waves of AI framework: [https:\/\/www.darpa.mil\/attachments\/AIFull.pdf]<\/div>\n
– Definitions of related concepts like GOFAI, Deep Learning, and Transformers: [https:\/\/en.wikipedia.org\/wiki\/Symbolic_artificial_intelligence], [https:\/\/en.wikipedia.org\/wiki\/Timeline_of_machine_learning], [https:\/\/en.wikipedia.org\/wiki\/Transformer_(deep_learning_architecture)]<\/div>\n
– Practical implications in enterprise settings, as seen in [AI and your Bill of Materials: why token limits are nothing new](www.quickrelease.co.uk\/insights\/ai-and-your-bill-of-materials:-why-token-limits-are-nothing-new<\/a>)<\/div>\n
<\/div>\n
#### Conclusion<\/div>\n
Peter Voss\u2019s third-wave AI, through cognitive architectures and graph-based systems, offers a promising approach to overcome the token limitations of second-wave AI. By enabling flexible, real-time, and reasoning-capable systems, it addresses the constraints of context handling, adaptability, and resource intensity, paving the way for AGI and broader application in solving complex global challenges.<\/div>\n<\/div>\n


<\/p>\n

\n
Steve Jobs Texted me on 650-283-8008 in the same way that Mr Jobs called Bill Hewlett <\/span><\/span><\/div>\n
<\/div>\n
https:\/\/x.com\/superSaiyanSkai\/status\/1941392367304761636\/video\/1<\/a><\/div>\n

<\/p>\n


<\/span><\/span><\/div>\n

9:59<\/span> video sums up 14 chapters of a book coming out 11-11-2019 “What They Will NEVER Teach You at Stanford Business School”
http:\/\/www.youtube.com\/watch?v=ejeIz4EhoJ0<\/span><\/span><\/p>\n


Fashion Week’s front row
http:\/\/www.youtube.com\/watch?v=QXIaNZi3mHQ<\/span><\/span><\/div>\n

What A Super Model Can Teach a Harvard MBA About Credit www.slideshare.net\/larrychiang\/what-a-super-model-can-teach-a-harvard-mba-about-credit<\/a><\/span><\/p>\n

American Express hosts me mentoring you about FICO scores at New York Fashion Week
t.co\/inxTmZAj<\/a><\/span><\/p>\n

My video boils down 20,000 hours and moves you to the right on the entrepreneur bell curve 
http:\/\/www.youtube.com\/watch?v=eudADPfTWiE<\/span><\/p>\n

CEO of Duck9
Founding EIR @Stanford<\/p>\n

Duck9 = “Deep Underground Credit Knowledge” 9
www.duck9.com\/blog<\/a><\/span>
650-566-9600<\/span>
650-566-9696<\/span> (direct)
cell: 650-283-8008<\/p>\n

****************
Editor of the widely syndicated “What They Don’t Teach at School”
whattheydontteachyouatstanfordbusinessschool.com\/blog<\/a><\/span><\/p>\n

CNN Video Channel: ireport.cnn.com\/people\/larrychiang<\/a><\/span><\/p>\n

Read my last 10 X posts at www.X.com\/LarryChiang<\/a><\/span><\/p>\n

Author of #WTDTYASBS a NY Times Bestseller released 09-09-09 at #NYFW on a runway under the tents
whattheydontteachyouatstanfordbusinessschool.com\/blog\/?s=Ny+times+bestseller<\/a><\/span><\/p>\n

www.fastcompany.com\/embed\/c0d4562ea2049<\/a><\/span><\/p>\n

52 Cards. Two Jokers. What They DO Teach You at Stanford Engineering
http:\/\/www.youtube.com\/watch?v=vDBY0GkI3-g<\/span><\/p>\n

Emergency swings and cutting deals as an 9 year old<\/p>\n

http:\/\/www.youtube.com\/watch?v=OFGY7v9C4G0&<\/span><\/p>\n

Hunter Pence shared thoughts before winning WORLD SERIES’ Game #7
http:\/\/www.youtube.com\/watch?v=usu0luYy9pw<\/span><\/span><\/p>\n


<\/span><\/span><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

    Larry Chiang, 650-283-8008 \u2066\u202a@LarryChiang\u202c\u2069 Walk me through Peter Voss\u2019 third wave ai and how exactly wave 2 ai falls short due to token limitations   7\/8\/25, 12:59\u202fPM     ### Key Points – Research suggests Peter Voss\u2019s third wave AI focuses on cognitive architectures mimicking human intelligence, aiming for Artificial General Intelligence (AGI) […]<\/p>\n","protected":false},"author":1,"featured_media":35036,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-35035","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"post_mailing_queue_ids":[],"_links":{"self":[{"href":"https:\/\/www.duck9.com\/blog\/wp-json\/wp\/v2\/posts\/35035","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.duck9.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.duck9.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.duck9.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.duck9.com\/blog\/wp-json\/wp\/v2\/comments?post=35035"}],"version-history":[{"count":0,"href":"https:\/\/www.duck9.com\/blog\/wp-json\/wp\/v2\/posts\/35035\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.duck9.com\/blog\/wp-json\/wp\/v2\/media\/35036"}],"wp:attachment":[{"href":"https:\/\/www.duck9.com\/blog\/wp-json\/wp\/v2\/media?parent=35035"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.duck9.com\/blog\/wp-json\/wp\/v2\/categories?post=35035"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.duck9.com\/blog\/wp-json\/wp\/v2\/tags?post=35035"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}