DALL·E 2024-07-07 21.53.30 - Abstract 3D visualization of a vast AI network, with vibrant streams of colorful light representing data flow between shimmering nodes. At the center,

Distributed LLM Inference and the Rise of Kuzco

What if your laptop could contribute to the AI revolution while earning you passive income? This is becoming a reality that projects like Kuzco are bringing to life through distributed LLM (Large Language Model) inference on the blockchain. In fact, it was exciting enough for me to build an AI mining rig . The GPU Dilemma: Untapped Potential A GPU (Graphics Processing Unit) is a specialized processor designed to handle multiple tasks simultaneously, making it essential for rendering graphics and accelerating complex computation. ...

IMG_6771

I Built an AI Crypto Mining Rig

I recently dove headfirst into the wild world of AI crypto mining. What is that you ask? It’s a relatively new concept of running AI requests on a global network of home computers, using the blockchain to secure operations and reward participants. My weapon of choice? A custom-built rig optimized to process Llama 3 8B inferences using the Kuzco platform on Solana . Specs Case: Lian Li Dynamic EVO XL (Warning: it’s heavy) CPU: AMD Ryzen 9 5950X (Cooled by the monstrous Noctua NH-D15 ) Motherboard: ASUS AM4 TUF Gaming X570-Plus (Wi-Fi) Graphics Card: ASUS GeForce RTX 4090 RAM: 128GB (Two 64GB kits ) Storage: 2TB SAMSUNG 980 PRO SSD Power Supply: Seasonic Focus V3 GX-1000 Case Fans: Lian Li UNI Fan SL-Infinity 120 (2x 3 packs) What I Wish I Knew Before I Started It’s been 15 years since I last built a PC. Here’s what I learned: ...

silv.eth_An_abstract_colorful_representation_of_a_brain_merged__1d27b098-98bd-4c4a-89de-d73dbb0f08ea

Latest AI Innovations: Gemini, Claude 3.5, UI Gen and More | June 2024

My mind is buzzing with fascinating AI developments I’ve encountered recently. Here’s a summary of the most exciting innovations: Gemini Context Caching ( demo / API docs ) Pass content to the model once, cache the input tokens, and refer to them for subsequent requests Claude 3.5 Sonnet launched Outperforms competitor models and Claude 3 Opus on various evaluations, with the speed and cost of Claude’s mid-tier models Claude AI Artifacts ( YouTube demo / blog post ) ...

June 21, 2024 · 1-minute read · matt silverman  · 
recursive-ai-acceleration

Recursive AI Acceleration in Software Engineering

The advancement of AI is happening faster than most people realize, and it’s set to revolutionize the world of software development. With the concept of Recursive AI Acceleration, the human researchers and engineers building the next generation of AI models can now use previous AI models to speed up their research and development process, creating a powerful feedback loop that’s driving innovation at an unprecedented pace. The ChatGPT 4 Inflection Point The release of ChatGPT 4 on March 14, 2023 , marked a significant milestone in the evolution of large language models (LLMs) . This advanced AI system demonstrated the potential for LLMs to make meaningful strides toward accelerating software engineering, paving the way for a new era of AI-assisted development. ...

DALL·E 2024-06-03 20.50.09 - A whimsical illustration of a magical seaside kingdom with a brave Princess Emilia, a glittering unicorn named Starbright, and a sparkling seashell. T

Teach Your Kids ChatGPT in 3 Minutes: Fun and Educational Storytelling

Large Language Models (LLMs) are expanding so quickly that it might be a time to consider introducing them to your kids (with close supervision). Here’s how you can get started. My prompt: Create a one-minute story about unicorns, princesses, and seashells for Emilia (5 years old) that teaches her about being strong and independent while still being caring and thoughtful. Use alliteration and rhyming when possible to make the story engaging. ...

June 4, 2024 · 3-minute read · matt silverman  · 
silv.eth_Digital_art_of_a_hand_holding_a_smartphone_displaying__463a7517-08a8-4092-ac87-bbea7d54017f

Are Online Lotto Ticket Auto-Fill Numbers Truly Random?

Did you know that the “random” numbers you get when you buy a Mega Millions ticket online might not be as random as the actual lottery drawing? It’s true! While the difference is small, it means you theoretically could be getting slightly worse odds. I checked out the Virginia Lottery website where you can buy Mega Millions tickets online. When you hit “auto-fill,” it happens so fast that it seems unlikely it’s getting truly random numbers from an external server. ...

June 2, 2024 · 2-minute read · matt silverman  · 
silv.eth_A_vibrant_dynamic_illustration_featuring_a_person_wear_90887854-0b09-4ceb-943a-de6ca89e4453

Unlock the Power of AI Research: A Beginner's Guide to Using LLMs for Pennies

Imagine having the power of advanced AI language models at your fingertips without breaking the bank. While most cutting-edge LLMs require a subscription, there’s a way to access them for pennies per query. Say goodbye to the $60/month price tag for Google Gemini, ChatGPT, and Claude. Introducing Big AGI , the game-changing free public LLM chat interface. Not only does Big AGI allow you to use every major LLM via API key, eliminating fixed recurring fees, but it also boasts a powerful " beam " feature. This lets you query multiple LLMs simultaneously and fuse the results together, reminiscent of the old search engine aggregator Dogpile . ...

May 27, 2024 · 2-minute read · matt silverman  · 
A super-intelligent AI librarian powered by Large Language Models (LLMs)

What is a Large Language Model (LLM)

Imagine a vast library filled with millions of books on every conceivable topic. Now, picture a super-intelligent librarian who has read and memorized every single word in those books. This librarian can answer any question you ask, translate languages, write creative content, and even summarize complex topics – all based on the knowledge absorbed from the books. That’s essentially what a Large Language Model (LLM) is – a powerful artificial intelligence (AI) system trained on an enormous amount of text data. ...

April 24, 2024 · 3-minute read · matt silverman  · 
silv.eth_Create_a_minimalistic_and_modern_featured_image_for_a__30392852-c617-4989-8eef-adbb583501f3

LLM Fusion: Your $60 Research Supercomputer

Edit 09/11/2024: You can now try LLM fusion without a subscription, see my newer post here . In my quest for reliable and comprehensive research on various topics, I developed the $60 LLM Fusion method. This approach harnesses the collective intelligence of the three state-of-the-art language models. For an example of how I used the LLM Fusion method, see teaching a 4-year-old girl to read with LLMs using the S-T-A-M-P method . Here is how LLM Fusion works: ...

April 17, 2024 · 2-minute read · matt silverman  · 
DALL·E 2024-04-02 22.15.19 - A stylized, overhead view of a kitchen counter with natural ingredients scattered around like salt, lemon, and magnesium, a digital tablet displaying

using AI to create the optimal homemade electrolyte drink recipe

When I feel dehydrated I love using something like LiquidIV to rehydrate, but the stuff is so expensive. I used the brain power of LLM Fusion to make the optimal recipe for me. Will be trying it soon and reporting back. you are a Registered Dietitian Nutritionist with a board certification in sports dietetics. give me an easy to make homemade batch recipe of electrolyte powder similar to liquidIV or LMNT that is very low sugar, clean ingredients, and is easy to mix with water. flavor of lemon lime. ...