That’s why we cook food. Cooked grain is way more nutritious than raw grain. The kitchen is an external stomach.

theres a difference between cooked rice and ritz crackers

ritz crackers are basically already digested before you eat them

I wore a glucose monitor for a few months and tested my blood sugar response to different foods. The worst spike I ever got was American Chinese food: rice+sugary sauce. Brown rice vs white rice makes no difference.

Ice cream didn’t make much of a spike - all that fat. Waffle with maple syrup and peanut butter is completely different profile than waffle without peanut butter.

Most important thing for my blood sugar was portion size. Eat a lot, get a big spike.

Frustrating to me that people argue so much about “processed” vs “unprocessed” food. The real issue I believe is portion sizes.

The Nemotron 3 family uses Mamba-2 because that is what we had validated when we started building the family.

Changing the SSM backbone is a major revision, not a dot release. At least for us.

Something poignant about the knowledge in this paper staying lost behind a paywall.

Supplementary materials https://www.science.org/doi/suppl/10.1126/science.adx4343/su...

Full text: https://www.science.org/eprint/QDZNYBWGCVEJ2RCTX5JI/full?act...

"A founder-engineer driven company. Facebook is one of the few Big Tech firms whose founder is an engineer, and still is the CEO. Netflix is the other one where founder and co-CEO Reed Hastings was also a software engineer before starting the company. Amazon was the other example of this until recently, but it’s not the case at Google or Apple."

So funny how people overlook Jensen Huang repeatedly. As if NVIDIA wasn't big tech, or Jensen wasn't a founder, or an engineer...

I have been in an SF muni car with someone actively smoking something that was not marijuana or a cigarette. I think it was fentanyl but I’m not sure. This was about two years ago. I hope this is tolerated less now than it has been.

Underrated comment

OMG

Some of these concerns are precisely why we are building Nemotron at NVIDIA. We want to make it possible for people to invent and deploy AI in all sorts of new and unforeseen ways.

Nemotron is:

1. Not just open weight, but open data (to the limits of what is feasible), open recipe, open technique

2. In the future built by a coalition of organizations coming together to build great openly developed AI.

Nemotron 3 Super is our most successful model yet. [1]

Ultra is coming soon. And then Nemotron 4.

We can afford to do this because when AI grows, NVIDIA's opportunity also grows.

[1] https://kaitchup.substack.com/p/the-fastest-and-cheapest-120...

Nemotron is great, keep up the good work!

how do you justify the compute investment for something like nemotron ? especially if all the labs are willing to pay for those same GPU clusters for inference or training runs?

Nemotron has two reasons to exist, both of which are strategic to NVIDIA.

1. Help NVIDIA design future systems for AI by more deeply understanding what it takes to build AI.

2. Keep the AI ecosystem strong and diverse throughout the world by providing AI infrastructure that many companies can innovate on.

This is not a science project, nor is it for the joy of giving something away. Both of these reasons are core to NVIDIA.

Does Nvidia maintain it's own compute hardware expressly for model training? Otherwise, I'm not sure how you keep up with the SOTA model techniques.

Yes

AI is a mirror. If you are boring, you will use AI in a boring way.