Showing posts with the label Supercomputers

Posts

Robots, churros and supercomputers!

Did you know that Europe is about to become the new Silicon Valley, but without so much traffic and with more paellas? It turns out that the European Union, in its infinite wisdom (and desire not to be left behind in the technological race), has decided to invest a fortune in creating things called "AI factories." Spain promotes one of the first proposals to create AI factories funded by the EU Imagine a factory, but instead of producing cars or shoes, it produces artificial intelligence! And what is that? Well, it's like having a giant brain in a computer, capable of learning and doing incredible things, like writing poems, composing music or even diagnosing diseases. Why so much excitement about thinking robots? Because artificial intelligence is the new electricity. Everyone wants a piece of it, and Europe doesn't want to be left behind. So they've decided to pit a bunch of countries against each other to see who can build the best AI factories. Spain, alwa...

AI Training Costs: The Staggering Cost of Teaching Machines to Think

You want to train a dog. Normally, you'd buy some treats, invest a bit of time and patience, and soon your four-legged friend would be sitting on command.  But what if training your dog suddenly cost as much as building a skyscraper?  Welcome to the crazy world of AI training! The Insane World of AI Training Costs: The Staggering Cost of Teaching Machines to Think From Cute Beginnings to Gigantic Wallets There was a time when you could train an AI on a small computer cluster - as cute as a puppy learning its first tricks. But those days are long gone. Today, training an AI is more like trying to teach a whale to dance - in an Olympic-sized swimming pool filled with liquid gold. Sam Altman of OpenAI recently dropped the bombshell: Training ChatGPT cost "significantly more than $100 million". Ouch! That's like spending the equivalent of a luxury car for every "Sit!" and "Stay!" The Cost Explosion: When Bits Become More Expensive Than Diamonds Le...

Introduction to TSUBAME 4.0 Supercomputer

Welcome to the wondrous world of TSUBAME 4.0 Supercomputer, where computing power reaches astronomical proportions and dreams of conquering the universe become a (slightly exaggerated) reality. Brace yourself for an epic journey through the depths of this remarkable machine. (toc) #title=(content list)   Technical Details of TSUBAME 4.0 Architecture: x86_64 CPU with CUDA GPU support Computing Performance: 66.8 petaflops in double precision, 952 petaflops in half precision GPUs: 960 NVIDIA H100 Tensor Core GPUs Processors: 240 HPE Cray XD6500 series servers with 4th generation AMD EPYC processors Memory: 768GiB of main memory per computing node Storage: Cray ClusterStor E1000 with 44.2 PB of hard disk-based shared storage and 327 TB of SSD-based high-speed storage Network: NVIDIA Quantum-2 InfiniBand network interface with 100 Gbps connection via SINET6 Software: Support for CUDA and various computational science and technology frameworks Usability: Virtualization technolo...

Stanford University’s AI Index Report 2023: The Current State of AI Research

Stanford University’s AI Index Report 2023: The Current State of AI Research Stanford University’s AI Index Report 2023: The Current State of AI Research Artificial intelligence (AI) used to be an exciting field of research, but now it has become primarily a money-making field for those who already have a lot of it. This is one of the key takeaways from Stanford University's AI Index Report 2023, which was recently published. The report provides a comprehensive overview of the state of AI research and its impact on society. One of the key findings of the report is that up until 2014, most of the major machine learning models were developed by public research institutions. However, the tech industry has now taken over the field, with 32 out of 35 major machine learning models released last year being developed by companies. This has led to a renewed concentration of power among tech companies, which have the resources required to develop state-of-the-art AI systems, such as supercom...