RE: @ned Needs A Tim Cook: Cost Of Nodes Plummets
Nodes did not drop in cost as much as the post leads to believe. The post wording is confusing and embellished.
First off, a full node hasn't taken 488GB in a long time (8-12 months), ram usage has been cut in half by using RocksDB for Account History for a long time now. This reduced ram usage to around 267GB currently.
A full node still takes more than 61GB, but with HiveMind, you can break Follow & Tags plugins to a separate server and are able to use 64GB servers for a full node. You will need 4-5 servers to create a full node instead of one larger server.
With HiveMind & RocksDB you can do a setup of
- 64GB Ram w/ NVMe drives (Account History Rocks DB)
- 64GB Ram w/ NVMe drives (Everything but account history, follow, tags)
- 32GB Ram w/ NVMe drives (HiveMind DB)
- 4GB Ram (HiveMind (App)
- 8GB Ram (Jussi)
In the future when MIRA is finished and stable, things will look even better. In this configuration, the NVMe drives are the bigger problem.
great information, when you say 'NVMe drives are the bigger problem' what do you mean? also, has anyone packaged this current config or is this available as a docker image or on github with the updated hivemind? i guess what i'm asking for is documentation to be able to spin up one and experiment. i presume i can spin up a testnet right?
There are not many providers that offer NVMe, and they are very expensive and generally very poor quality. NVMe drives and the servers that house them vary dramatically. This dramatically limits the service providers that offer this these configurations. The range in price is huge as well, with 95% of the providers 300% more expensive.
roger that, thanks for the information, so the NVMe high quality drive is the way to go, i presume you could raid a bunch of samsung ones right? -- what about building out your own 1u/2u box and co-locating it using high quality components? is that the way to go potentially?
Just to put things in perspective:
Collocation is the best option, but upfront hardware costs are pretty high. Even if you manage to get all the hardware together, collocation costs are pretty steep as well. Especially if you are in the US where bandwidth and electricity costs will cost far more than just renting.
Wow, sorry to hook in here but I love speedy discs and what a specs. NVMe, I don't get it, it works with e.g. SSD so I am thinking direction bus architecture but you plug it in a PCI slot? Where do I place this?
Posted using Partiko Android
NVMe is an SSD drive (Solid State) but instead of using the SATA Bus (Sata 3 capped at around 550-600 MB/s) it uses a 4x PCI-Express bus (4x capped at near 4,000 MB/s Gen 3, Gen 4 8,000 MB/s but no drives support this.).
i used to run a GSP so i understand all the costs. thanks for the additional information, i also know the company i used to host my game server company went on to do co-location server hosting for a mining app and yes, upfront costs are expensive especially when that will be outta date in six months time potentially. thanks for the speed stats.
That's the other thing when MIRA is released and stable the specs will change a lot.
roger that. i'll keep a search for MIRA related posts going then as well.