Rich's Tongfamily

An interview with Devindra about the future education in the world of ChatGPT and Large Language Models.

ST1. August Update on AI 2024-08-08 – Rich Tong Family and Friends

There's been a hiatus mainly because we've been shipping products, but more because I lost all my skills at making new videos. I was stuck for a long time on Drop Zones and doing a better intro and outro, but that's a digression for Final Cut Pro nerds. In this episode, we cover the latest trends as of August 8, 2024, on AI and the latest trends. The big news has been the shipment of so many Large Language Models (LLMs) and what it means for AI which is way more choice and confusion. Plus the emergence of a much better set of tools that are much smaller as well called Small Language Models (SLM sometimes) and also Agents that are chopping the problem into many small pieces. I also wanted to introduce Steven to the mix, we are going to have a rotating set of co-hosts and solo episodes as well so we can get the content out on time and not take 6 weeks for post productions. Thanks to the new intro and outro, that should be easier. I'm playing with these a bunch, but check out https://tongfamily.com and https://tne.ai where I hang out a bunch!

1. ST1. August Update on AI 2024-08-08 53:06
2. RT3. AI Hardware Introduction 30:21
3. DT6. AI Intro and Intuitions 53:08
4. DT5. 8 AI Diamonds for you. Insights from 2023 and 2024 Predictions 01:50:55
5. RT5. Testing, testing, 1, 2, 3… 03:04

Show Notes

A conversation with Devindra on the possibilities of ChatGPT and other Large Language Models for education in India and other Middle and Low-Income Countries. While these large language models today mainly work in the cloud and require high-speed internet connectivity, the promise is that smaller models that are more specialized have already been ported to MacBook Pro M1 and other laptops. And with advances like 4-bit quantization, there is the possibility they can even run on modern smartphones.

The experience in China and in India is that parents will save inordinately to give their children a better life than theirs. Both Devindra and I are the beneficiaries of that thinking and we are forever grateful to our parents for their sacrifice. So, this means that there is a possibility that there could be a commercial incentive which is much better than constantly asking for charitable dollars.

The new LLMs promise interactivity and individualized instruction that was impossible before. Early demonstrations of learning a foreign language are promising as is the student being able to ask the “why” of how Python is structured, not just the “get it done” without understanding that online education often creates. Finally, having an eye toward inclusivity for everyone of any gender, race or social status is something that needs to be baked in. We look forward to helping!

The Zoom version

This one has better video and the demo in full screen. Apologies, I’m still working through making this OBS Studio stuff work well. But the one above is in full 4K HDR so there’s there 🙂