DALL·E 2024-07-07 21.53.30 - Abstract 3D visualization of a vast AI network, with vibrant streams of colorful light representing data flow between shimmering nodes. At the center,

Distributed LLM Inference and the Rise of Kuzco

What if your laptop could contribute to the AI revolution while earning you passive income? This is becoming a reality that projects like Kuzco are bringing to life through distributed LLM (Large Language Model) inference on the blockchain. In fact, it was exciting enough for me to build an AI mining rig. The GPU Dilemma: Untapped Potential A GPU (Graphics Processing Unit) is a specialized processor designed to handle multiple tasks simultaneously, making it essential for rendering graphics and accelerating complex computation. ...

IMG_6771

I Built an AI Crypto Mining Rig

I recently dove headfirst into the wild world of AI crypto mining. What is that you ask? It’s a relatively new concept of running AI requests on a global network of home computers, using the blockchain to secure operations and reward participants. My weapon of choice? A custom-built rig optimized to process Llama 3 8B inferences using the Kuzco platform on Solana. Specs Case: Lian Li Dynamic EVO XL (Warning: it’s heavy) CPU: AMD Ryzen 9 5950X (Cooled by the monstrous Noctua NH-D15) Motherboard: ASUS AM4 TUF Gaming X570-Plus (Wi-Fi) Graphics Card: ASUS GeForce RTX 4090 RAM: 128GB (Two 64GB kits) Storage: 2TB SAMSUNG 980 PRO SSD Power Supply: Seasonic Focus V3 GX-1000 Case Fans: Lian Li UNI Fan SL-Infinity 120 (2x 3 packs) What I Wish I Knew Before I Started It’s been 15 years since I last built a PC. Here’s what I learned: ...

silv.eth_An_abstract_colorful_representation_of_a_brain_merged__1d27b098-98bd-4c4a-89de-d73dbb0f08ea

Latest AI Innovations: Gemini, Claude 3.5, UI Gen and More | June 2024

My mind is buzzing with fascinating AI developments I’ve encountered recently. Here’s a summary of the most exciting innovations: Gemini Context Caching ( demo / API docs) Pass content to the model once, cache the input tokens, and refer to them for subsequent requests Claude 3.5 Sonnet launched Outperforms competitor models and Claude 3 Opus on various evaluations, with the speed and cost of Claude’s mid-tier models Claude AI Artifacts ( YouTube demo / blog post) ...

June 21, 2024 · 1-minute read · matt silverman  · 
recursive-ai-acceleration

Recursive AI Acceleration in Software Engineering

The advancement of AI is happening faster than most people realize, and it’s set to revolutionize the world of software development. With the concept of Recursive AI Acceleration, the human researchers and engineers building the next generation of AI models can now use previous AI models to speed up their research and development process, creating a powerful feedback loop that’s driving innovation at an unprecedented pace. The ChatGPT 4 Inflection Point The release of ChatGPT 4 on March 14, 2023, marked a significant milestone in the evolution of large language models (LLMs). This advanced AI system demonstrated the potential for LLMs to make meaningful strides toward accelerating software engineering, paving the way for a new era of AI-assisted development. ...

DALL·E 2024-06-03 20.50.09 - A whimsical illustration of a magical seaside kingdom with a brave Princess Emilia, a glittering unicorn named Starbright, and a sparkling seashell. T

Teach Your Kids ChatGPT in 3 Minutes: Fun and Educational Storytelling

Large Language Models (LLMs) are expanding so quickly that it might be a time to consider introducing them to your kids (with close supervision). Here’s how you can get started. My prompt: Create a one-minute story about unicorns, princesses, and seashells for Emilia (5 years old) that teaches her about being strong and independent while still being caring and thoughtful. Use alliteration and rhyming when possible to make the story engaging. ...

June 4, 2024 · 3-minute read · matt silverman  · 
silv.eth_Digital_art_of_a_hand_holding_a_smartphone_displaying__463a7517-08a8-4092-ac87-bbea7d54017f

Are Online Lotto Ticket Auto-Fill Numbers Truly Random?

Did you know that the “random” numbers you get when you buy a Mega Millions ticket online might not be as random as the actual lottery drawing? It’s true! While the difference is small, it means you theoretically could be getting slightly worse odds. I checked out the Virginia Lottery website where you can buy Mega Millions tickets online. When you hit “auto-fill,” it happens so fast that it seems unlikely it’s getting truly random numbers from an external server. ...

June 2, 2024 · 2-minute read · matt silverman  · 
silv.eth_A_vibrant_dynamic_illustration_featuring_a_person_wear_90887854-0b09-4ceb-943a-de6ca89e4453

Unlock the Power of AI Research: A Beginner's Guide to Using LLMs for Pennies

Imagine having the power of advanced AI language models at your fingertips without breaking the bank. While most cutting-edge LLMs require a subscription, there’s a way to access them for pennies per query. Say goodbye to the $60/month price tag for Google Gemini, ChatGPT, and Claude. Introducing Big AGI, the game-changing free public LLM chat interface. Not only does Big AGI allow you to use every major LLM via API key, eliminating fixed recurring fees, but it also boasts a powerful " beam" feature. This lets you query multiple LLMs simultaneously and fuse the results together, reminiscent of the old search engine aggregator Dogpile. ...

May 27, 2024 · 2-minute read · matt silverman  · 
silv.eth_A_warm_empathetic_illustration_of_an_AI-Powered_Mental_7821476d-349a-41f7-8c05-b325bd5d0a9d

10 AI-Driven Jobs You Haven't Heard Of Yet

I am curious about what jobs will exist five years from now due to AI but are not on most people’s radar today. Using the LLM Fusion technique, I entered this prompt: What type of job will exist in 5 years from now due to AI and be popular but we don’t think about it now. List 10 discrete jobs with details about the job. then based on the results, choose the three jobs that might be easiest to prepare for now, and summarize an action plan to stay ahead of the curve for that specific job ...

May 19, 2024 · 3-minute read · matt silverman  · 
DALL·E 2024-05-16 18.49.53 - A blog post featured image illustrating the process of using Bitwarden to autofill complex login forms like American Airlines. The image should show a

How to Use Bitwarden to AutoFill Complex Login Forms like American Airlines

This took me way too long to figure out. Bitwarden is amazing once it’s properly configured, but every once in a while there is a pesky site that doesn’t autofill all the fields you need to login. I finally today discovered a hidden feature to reliably add custom fields from any site to autofill with Bitwarden. Locate the pesky field in your desktop browser with Bitwarden browser extension installed, right-click the field, and select “copy custom field name.” ...

silv.eth_a_strong_concrete_bridge_that_looks_flawless_and_is_a__5db26808-0b39-4779-b5ab-679f485d37c6

Self-Healing Concrete: The Future of Construction?

Ready for a 2-minute primer on a revolutionary technology? Let’s learn about self-healing concrete. What is Self-Healing Concrete? Self-healing concrete is a type of concrete that can fix its own cracks. Special bacteria or healing agents are mixed into the concrete and they react with water and air to heal cracks when they form. This is a big deal because normally, cracks in concrete can lead to big problems like weakening structures and costly repairs. ...