Introducing MIRA

in #steem6 years ago

MIRA.jpg

Hello Steemians,

On Monday we shared a short update on our progress and now we want to update you on a brand new technology we are developing for Steem called MIRA, which stands for Multi Index RocksDB Adapter. The purpose of MIRA is to allow Steem blockchain nodes to store almost all necessary data on disk in a modern database instead of in RAM. One of the things we are focusing on right now is getting RocksDB working with data consistency. We have the first implementation of MIRA done and building with steemd, and are currently working on debugging and testing.

One advantage of this is that nodes will be more performant on average hardware. The other benefit is that nodes will cost much less to run. In both cases, this helps Steem be more easily adopted by application developers and exchanges. Consequently, Steem should become even more decentralized as the barrier to entry for running nodes is dramatically lowered.

The Steemit Team

Sort:  

Awesome! Decentralisation and lowering of the costs of the full nodes are extremely important.

Is it possible to say by how much this first implementation of Mira will lower the RAM costs?

Now can we get someone to just setup a microsoft visual studio stub project with all the npm dependcies setup...

It would open up the world to working with corporate types, and small businesses using Viual Studio, and Sharepoint.

Not to mention connection to any database in the worldthrought dao and odbc.....

it's a no brainer!!!!

It should take a couple of hours if we got 2 people together:
a Programmer familar Microfoft Studio and npm,
a Programmer or Admin with knowlegable of the depencies to build steemdb, steem and steem/js library and tutorials

A simple step by step with screen snaps tutorial post or a video could be done!

I know at least 10 programmers who would start programming on Steem if that was available....

I assume that the end result would be more nodes coming on line!

cyrus_tagline.jpg

I love this idea.

thumbsupcolor.jpg

I just got unanimous agreement from all the
Members of the Steeminati
(that responded to my text)

This is a worthy addition to the Steem Community....

We will be putting up a post up with a BOUNTY reward for a couple of fellow techies to do it!!!!!
happyuser1.jpg
It will come out of the Steeminati group pool!

Once verified, The files will will be put on Github and shared with the community.....

IntroducingRichAtVNSwithsign.jpg

Rich,

if you get it from someone, can we discuss having my license connect to whatever selling sources are on steem?

I think gamebrain could use Steem as a venue.....

yes yes yes, I could use it in my class, I'm learning VBA right now....
I could use the reports in accress or excel, and bring threads into powerpoint!!!!

That's a great idea!!!!
kingcal.jpg

I just called rich on this comment ...I bet he chimes in with in 5 mins...lol

What is the main difference between VBA and VSCode? I remember the Microsoft CEO in the CNBC interview about Microsoft purchasing Github,

he states that VSCode is the open source version of VBA, so I assume you must pay for VBA, and I also assume, you might not have access to some of the dependency extensions available to the Open SOurce users. These comments are recent, but there are some pretty legit Mark Down extensions that come very very close to Steemit's style, but I do agree wtith @cyruss33.

THIS WOULD MAKE A WORLD OF DIFFERENCE







anchor.fm/alphawave

Decentralized is the first step.
Distributed is the best way to keep it secure and running without having some big guys playing their game.

Thanks for the visualisation.

i don't like black boxes.

microsoft is a black box, willing to buy your individual text messages from facebook.

But is Microsoft decentralized enough?

GitLab is git without GitHub and remains independent. Many have moved from GitHub to GitLab due to Microsoft's acquisition of it. Maybe this would be something to consider?

Yes. We should run from Microsoft.

microsft owns github... aka the defacto open source library and sure u can shrug that off... but they probably pay tens of thousands of dollars a second to keep all the worlds most important files online at all times... free... for noone to ever think about .

could be the first part of a big game changer in securing the network.

I was thinking the same thing, security is the only thing I take more serious than comedy lol! "Truce"

100% with you there. I do have some questions about how secure this is against Russian hackers though. It would also allow me to put that server I have sitting in my spare bathroom to use and maybe open up a witness node.

Do it! I would love to see your witness campaign - perhaps it would be entertaining as a run up to 2020?

well, from what i hear from the news that trickles down to the hinterland here that might not even be such a far-fetched notion atm ... at the risk of #offtopic on post , i think they're just letting him run into his own demise. The best thing for them do , lol, way better than impeachment since that would mean they're the opposing party and get his quite persistent following on their necks ...

as for the rocksdb thing ... i'm the type o' guy to see it when it gets there ... @goldmanmorgan / @tyrnannoght doesnt really need an SMT as its "virtual" or simulated or whatever you wanna call it (i think technically that could mean i could port it to any chain that allows freebie points and coin to be gathered in the end (by 2050 or so lol) since its only dependent on incoming vote values which could be calculated from any give set (hear me talk lol, like a boss)

however

i always like

cooltext263014691606796.png

... looking forward to it but hoping it doesnt just lead to another zound of currencies dispersing the total capital from those already in existence, so

it's up to the weirdo's and the freaks to make

creative use of resources then, can we rank-amateurs hack it in a way none of the scholars thought of (as in "hack it" ... slang for do it , please dont mis-understand :))

sincerely ,

cathublogo.png

the site is down btw, its a toy bedroom server like ms. Clinton talks about and i had some serious poking i saw in my logfiles so its offline (the front anyway, the autovoters still run)
yay for steemchain ! good to see no one is throwing in the towel

As long as we are around poking, all creative ideas count bonus points. Like you said, Steem is mostly an environment for deployment!

that's a nice way of saying it ... it doesn't present itself like that , though :) but it IS , i agree, a fabulous new thing to play with hahah. Compared to any kind of hybrid before i havent gotten this creative in years.
The problem there, as it is presented too, is that a lot of people see "creativity" in very narrow, small kinds of ways , you know ?

Like my old man would say only Bach and Mozart is music (so to speak, because he like the stones and the beatles too and stuff like that and more, but you know what i'm getting at, i suppose)
You write some back-end that's pages long for a front-end that doesn't even fill out half a page and "its not writing" ... therefor it is not

its that kind of ancient greek logic that often gets on my system :p

despite all the kindergarten politics making it look like real elected parliament on top is real elected parliament on top and the content fasciscm, making it look like the government doesn't mind hiring legalized mafia as long as they're in place getting the real money.

Despite all that, it's STILL the demoscene of blockchain. I wouldn't even know where to do this with ETH or TRON or EOS, to name but three of the ones who thought themselves big before the great price war against the vampires and the old gold king, because that are all places you have to buy in ... at least here they pretend you can come in without money lol.

And afaik flixxo doesnt HAVE any kind of api as they don't even have their own blockchain and they're completely hybrid, so that's just a platform in essence where you can't get creative in anything but the thing that's already static by the time you upload (whereas i consider my little baby @tyrnannoght to be slowly growing into something truly dynamic, for instance, as it ever-changes by itself ...)
The upcoming (read : promise by Basic Attention Token (BAT - brave browser) is for now still just that : a promise, but that will be nothing more than getting tokens to give tokens out, which is GOOD , because at least you GET some lol, where i think , like flixxo it should also be a bit more dynamic like : if all you do is watch ads and never buy, the amount you get should be less. But they're REALLY slow in development, for instance i got like ... last time i checked 165 videos seeding, must be close to 200 now but the reward-by-seed number has been stuck at the same for a long time now and i can't even scroll down in they UI/client to see the bottom of the list ... for example hahah, on the other hand the speed at which they're moderating is increasing, it doesn't take a month or more anymore to get a video accepted.

other than that ... despite the governments cracking down on ICO's to protect the gullible from themselves (after they asked for it, after they got too greedy and their gullibility got them ripped off) most of it is still marketeers trying to sell hot air or stuff they don't have yet for a wad of cash. All those "crypto-anarchists" either don't make much noise or are long bored since the crypto-capitalists took over.

Other than steemit , bat and flixx i can't really think of anything i checked out that i would even sign up for as its almost all "pay us first so we can next year "maybe" get you a fabulous new system that's an old system with a new name"

and then some ... i probably used up the internet again with the reply but as you see, i still do reply even if its a month ago, maybe i'll even catch up as i'm not talking much lately

@ecoinstant

Please don't kill me.

Nobody can kill you, if you are distributed ;-)

Not only a big game changer, but would be one which will make new path to even other such currencies.
And the best part would be that the user like me and you will get benefits.

wasup Truce my big black succesful nigga for real

 6 years ago (edited)

Thanks @exyle!

While a lot of work on this has already been completed, it will be much easier to definitively answer that question after we get a little bit closer to completion.

The question is why wasn't this done last year, but better late than never. Steem really needs this.

I support 100% with you there. My questions is about how secure this is against Russian hackers though. It would also allow me to put that server I have sitting in my spare bathroom to use and maybe open up a witness node.

Agreed, it is very Oatmeal Awesome.

Here, have a small upvote from me too. Thank you for showing in such a brilliant yet simple way, what a big shithole this place has turned to be thanks to the idiots running it.

Well, if you are gonna get screwed you should at least have fun with it. I suggest.........................

FB_IMG_1545414062378.jpg

Disclaimer: May not taste like real pickle.

This post has received a 7.72 % upvote from @boomerang.

Ho! Ho! Ho! Merry Christmas!!! I've given you an upvote and left you this amazing automated comment!!!!

How about giving ol' @berniesanders a follow, eh?

Hey Bernie can I sit on good ol Santa Bernie's knee and tell him what I want for Christmas :P

lol

berniefunny.jpg

@berniesanders I know what I want for Christmas :D

Must be a really good thing if you made ol bernie happy! 😄

Part of the Flag War Peace Dividend. Bernie is a changed man. 😎

Actually steem has many forks from golos to... the upcoming SMTs.... there will be many steem's hopefully bitch

Hey man youre picture is triggering my small hole phobia aka Trypophobia

Im shuttering right now , shiveriong, even though IU know the makeup VFX pics are all fake, like oif the tiny holes in peoples hands and feet, but its still triggeringyuck

It's so important to have these updates. They build moral and confidence.

Please keep them coming!

Why is this trash pinned to my feed? I feel raped.

You don't own your feed. You are browsing a centralized website controlled by Steem Inc. They have the right to show you everything that is legal no matter how distasteful it is to you.

And I have every right to complain

hahaha good one @trumpman ! :D

You forgot the regular: "Trending is brokan!"
😂

imagine all this downsizing ends up with steem getting caught up in a bull run

I think direction is critical. I am curious about a few things.

  1. Can you through more Ram than required to speed up a node. Say this takes ram requirements down to 16gb. Would having a 64Gb node allow for caching or will that only be Jussi job.

  2. How close to the 4gb ram target do you think the first iteration would take us?

  3. On a node with significant ram (256gb-512gb) would this be slower than the current system?

 6 years ago (edited)

These are all fair questions - while a lot of this project is already completed, it will be much easier to answer these questions once we get a little bit closer to completion. I believe the answer to #1 is 'probably not in the first iteration'. This is also being implemented as a plugin, so it can still be done the 'old' way.

Good to hear of this progress Justin.

Is development still on the schedule Ned outlined a couple of weeks back? ie to have it ready to roll out by end of January-ish ?

Tomorrow, Thursday 8pm - 11pm on MSP Waves we have the second State of Steem Forum - this week focussing on Technology including nodes, RocksDB etc.

Would you or anyone else from Steemit Inc be able to pop along for 20 minutes to give an update and maybe answer a few questions?

Thank you



Correct me if I’m wrong, but wouldn’t the extra RAM be used by the OS as buffer cache for the disk-backed RocksDB files, like every other disk-backed database?

Yes, RocksDB itself does technically do this (or not if allow_os_buffer is set to false) - certain things could also be supported through runtime/compile time options. I believe the OP may have been asking about something more like using different storage methods for portions of the DB and not necessarily OS level caching.

Some really good points there @themarkymark

imagine all this downsizing ends up with steem getting caught up in a bull run

Outstanding effort, to lower the costs and promote decentralization. Can we get it down to the point we can get regular users to be full, or more likely, partial nodes?