DeepSeek has humiliated the entire US tech sector. I wonder if they will learn from this, fire their useless middle management and product managers with sociology degrees, and actually pivot to being technology companies?
"Again, just to emphasize this point, all of the decisions DeepSeek made in the design of this model only make sense if you are constrained to the H800; if DeepSeek had access to H100s, they probably would have used a larger training cluster with much fewer optimizations specifically focused on overcoming the lack of bandwidth."