22,000 Supermicro 7089P-TR4T Barebone 7U SuperServer
80,000 8 x xeon 8180
440,000 96 x M386AAK40B40-CWD
80,000 8 x Tesla V100
--
$622,000
12TB Ram
256GB VRAM
224 CPU cores / 448 threads
40,960 CUDA Cores
5,120 Tensor Cores
15.5 TFlops DP
$2776 per VM
224 VMs | 1 Core / 53GB Ram
$1388 per VM
448 VMs | 1 Thread / 26.5GB Ram
---
Ram is still stupid expensive.
Getting really close to 32 core (intel) cpu's.
Don't feel like digging into this boxes PCI express support (claims 39 slots)
Single xeon 8180 supports 48 lanes so in theory you could have 24 x 16 PCI cards with 8 cpu.
Some mix of GPU/Network/Storage controllers, you could just dump in all into network and put the GPU and Storage elsewhere.
--
technological singularity.. we're close
Things are gonna get weird, the system above is about 10^12 and is using 14nm process, 5nm has been reached by IBM (last summer) and we might get to 2-3nm.
We can't really make them run faster (heat) and we can't make them much smaller (quantum uncertainties) so we are scaling cores, dies are getting huge.
The last single core Intel was the Celeron 445 in 2013 (1.86GHz)
The current fastest single thread speed is the intel i7-8700k @3.7Ghz (6 cores/12 threads).
This is what a 28 core 8180 package looks like.
Moore's law
Current research is saying it will fail around 2025, but then you can't predict the future and people keep saying we can't keep following moore's law but then something changes and we can.
We are learning how to make things taller with 3d stacking.
This is IBM 5nm process with stacked layers
This was the intel 4004 circa 1971, it had 2,250 transistors and used a 10,000nm process (10um) and did 92,000 instructions per second on a 12mm² die.
Intel claims 100Bil per mm² with 10nm so that would work out to 1200 billion transistors on the die size of a 4004.. 533,333 x improvement in ~ 47 years.
The 3d part is interesting because we are just starting that path really.
This was sim city in 1989.
This is what people do in cities skyline (current city builder game)
This is Tokyo
You might see where I'm going with this, we might not be able to make chips smaller or denser but we sure can make them taller and we are just beginning that trend. I imagine cpu's in the years to come will have a surface complexity that resembles a city.
There are also quantum computers, this stuff is real, it's now.
https://futurism.com/google-just-revealed-how-theyll-build-quantum-computers/
An ordinary bit can be either a 1 or a 0, a qubit can be both a 1 and 0 at the same time.
Google says "The ability of quantum machines to outperform classical computers is called quantum supremacy"
"a quantum computer with just 50 qubits could outperform even the world’s most powerful supercomputers"
https://futurism.com/ibm-announced-50-qubit-quantum-computer/
IBM has 50-qubit quantum computer, quantum state is preserved for 90 microseconds.
"We are really proud of this; its a big frickin deal"
IBM says it has simulated a 56-qubit computer.
So we are right on the edge of making computer systems that can out think humans, all of them at once, this will lead to machines that are far more complex than humans can understand.
Interesting times..
80,000 8 x xeon 8180
440,000 96 x M386AAK40B40-CWD
80,000 8 x Tesla V100
--
$622,000
12TB Ram
256GB VRAM
224 CPU cores / 448 threads
40,960 CUDA Cores
5,120 Tensor Cores
15.5 TFlops DP
$2776 per VM
224 VMs | 1 Core / 53GB Ram
$1388 per VM
448 VMs | 1 Thread / 26.5GB Ram
---
Ram is still stupid expensive.
Getting really close to 32 core (intel) cpu's.
Don't feel like digging into this boxes PCI express support (claims 39 slots)
Single xeon 8180 supports 48 lanes so in theory you could have 24 x 16 PCI cards with 8 cpu.
Some mix of GPU/Network/Storage controllers, you could just dump in all into network and put the GPU and Storage elsewhere.
--
technological singularity.. we're close
Things are gonna get weird, the system above is about 10^12 and is using 14nm process, 5nm has been reached by IBM (last summer) and we might get to 2-3nm.
We can't really make them run faster (heat) and we can't make them much smaller (quantum uncertainties) so we are scaling cores, dies are getting huge.
The last single core Intel was the Celeron 445 in 2013 (1.86GHz)
The current fastest single thread speed is the intel i7-8700k @3.7Ghz (6 cores/12 threads).
This is what a 28 core 8180 package looks like.
Moore's law
Current research is saying it will fail around 2025, but then you can't predict the future and people keep saying we can't keep following moore's law but then something changes and we can.
We are learning how to make things taller with 3d stacking.
This is IBM 5nm process with stacked layers
This was the intel 4004 circa 1971, it had 2,250 transistors and used a 10,000nm process (10um) and did 92,000 instructions per second on a 12mm² die.
Intel claims 100Bil per mm² with 10nm so that would work out to 1200 billion transistors on the die size of a 4004.. 533,333 x improvement in ~ 47 years.
The 3d part is interesting because we are just starting that path really.
This was sim city in 1989.
This is what people do in cities skyline (current city builder game)
This is Tokyo
You might see where I'm going with this, we might not be able to make chips smaller or denser but we sure can make them taller and we are just beginning that trend. I imagine cpu's in the years to come will have a surface complexity that resembles a city.
There are also quantum computers, this stuff is real, it's now.
https://futurism.com/google-just-revealed-how-theyll-build-quantum-computers/
An ordinary bit can be either a 1 or a 0, a qubit can be both a 1 and 0 at the same time.
Two ordinary bits have 2² potential positions.
Two qubits have that same potential all at once.
Adding qubits expands potential exponentially.
Google says "The ability of quantum machines to outperform classical computers is called quantum supremacy"
"a quantum computer with just 50 qubits could outperform even the world’s most powerful supercomputers"
https://futurism.com/ibm-announced-50-qubit-quantum-computer/
IBM has 50-qubit quantum computer, quantum state is preserved for 90 microseconds.
"We are really proud of this; its a big frickin deal"
IBM says it has simulated a 56-qubit computer.
So we are right on the edge of making computer systems that can out think humans, all of them at once, this will lead to machines that are far more complex than humans can understand.
Interesting times..
Leave a comment
contemplative
cheerful
geeky
bouncy
sleepy
accomplished
