BitShares entered unplanned maintenance mode

in #bitshares7 years ago (edited)

around 1 hour ago BitShares network halted due to unknown reasons.

Witnesses and Developers are debugging at the moment and working on a fix

What does that mean for you

  • Do NOT Withdraw to your wallet at the moment
  • Your funds are safe (Blockchain state is secure)
  • For shorters: Price feeds are valid for some days and based on median

Will keep you updated

Update 10

network is operational.

Update 9 (UTC 17:25)

Roelandp:
participation rate at 22% witnesses rebuilding and running on a slowly rolling out network of seednodes.

Roelandp:
as per @dan: 'exchanges also need to update software'

Update 8 (17:18 UTC)

Ryan R. Fox (Fox):
The BitShares blockchian is currently bringing witnesses online at this time.

Update 7 (16:04 UTC)

@dan

I have identified a fix that enabled my local node to produce blocks. Witnesses are testing the fix now.
https://github.com/bitshares/bitshares-core/pull/324/files

Update 6 (15:50 UTC)

Ryan R. Fox (Fox):
The BitShares blockchain remains halted. The root cause has been identified. The Core Development Team is coordinating a release at this time. Witnesses will be notified to update their nodes thereafter. Please expect another update in nearly 30 minutes.

Update 5 (15:05 UTC)

Ryan R. Fox (Fox):
The BitShares blockchain remains halted. The Core Development Team continues to actively identify the root cause. Witnesses are available to implement the resulting patch when it becomes available. Please expect another update in nearly 30 minutes.

Update 4

Ryan R. Fox (Fox):
The BitShares blockchain remains halted. Daniel Larimer is actively working with the BitShares Core development team to identify the root cause of the issue.

Update 3

Ryan R. Fox (Fox):
The BitShares network remains halted. The Core Developers are actively debugging. A re-sync is in progress to further their investigation. Expect another update in ~30 minutes.

Update 2

From Telegram:

The BitShares blockchain is halted. No blocks are being produced. No transactions are being processed. This results in all blockchain data being protected as is. The Witnesses and developers are actively debugging the issue and working to restore the blockchain at this time. Please expect another update within the hour.

Update 1

join our Telegram to get live updates as they come in: https://t.me/BitSharesDEX

Sort:  

All software has potential for undiscovered bugs even after years of stable use. This is not a consensus failure because all nodes stopped at once and there are no forks. All nodes "agree" on the bug.

Once the bug is fixed all nodes will resume.

It is worth noting this is the first glitch in over two years of operations - during much which BTS was processing more daily tx than BTC. It is much better to find and resolve these issues now when BTS/STEEM/EOS are in their infancy than a few years down the road when they have become global financial titans.

If you've ever seen a bank machine ATM say "Sorry, currently unavailable. Or not in service" in your entire life. You'll understand this happens rarely, but it does happen. Anything that runs on software needs to be tweaked, upgraded, and maintained from time to time.

My level of worry from 0% to 100% is exactly 0%

Thanks for clarifying. I think everyone panics when they don't know what's going on. Easy to imagine the worst.

is this bug affecting (possibly) other graphene coins? ie should STEEM add this?

Update1: join our Telegram to get live updates as the come in: https://t.me/BitSharesDEX

From Telegram:

The BitShares blockchain is halted. No blocks are being produced. No transactions are being processed. This results in all blockchain data being protected as is. The Witnesses and developers are actively debugging the issue and working to restore the blockchain at this time. Please expect another update within the hour.

Ryan R. Fox (Fox):
The BitShares network remains halted. The Core Developers are actively debugging. A re-sync is in progress to further their investigation. Expect another update in ~30 minutes.

Ryan R. Fox (Fox):
The BitShares blockchain remains halted. Daniel Larimer is actively working with the BitShares Core development team to identify the root cause of the issue.

Witnesses are incapable of producing blocks b/c there is an issue that prevents verifying the previous chain - a particular transaction is fouling up the works. Dan Larimer and witnesses are working the problem as fast as possible.

Update 5 (15:05 UTC)

Ryan R. Fox (Fox):
The BitShares blockchain remains halted. The Core Development Team continues to actively identify the root cause. Witnesses are available to implement the resulting patch when it becomes available. Please expect another update in nearly 30 minutes.

Update 6 (15:50 UTC)

Ryan R. Fox (Fox):
The BitShares blockchain remains halted. The root cause has been identified. The Core Development Team is coordinating a release at this time. Witnesses will be notified to update their nodes thereafter. Please expect another update in nearly 30 minutes.

Update 8 (17:18 UTC)

Ryan R. Fox (Fox):
The BitShares blockchian is currently bringing witnesses online at this time.

Update 9 (UTC 17:25)

Roelandp:
participation rate at 22% witnesses rebuilding and running on a slowly rolling out network of seednodes.

Roelandp:
as per @daniellarimer: 'exchanges also need to update software'

Dan is now working with the Bitshares core devs to resolve.

Aaaand we're back and this why BTS is the best crypto on the planet.

Geez. This is not good at all. Having an entire decentralized blockchain halt all at once, effectively locking everyone out of their wallets and their stores of value ... that't not supposed to be able to happen. Is there a flaw in DPOS? Was it a specific error or attack? How BitShares recovers from this is going to impact its future in important ways. Might also impact Steem, Peerplays, and EOS.

Thanks for keeping us informed. Resteeming.

steem was down a lot in the past, it's not a big deal. unlike centralized exchanges, nothing can happen to your money on a blockchain.

That must have happened over a year ago, prior to when I was here. It's just surprising to me since BitShares has been running for a long time. I'll be very interested to see how this all shakes out. I agree with what I'm seeing in Telegram: software always has bugs. What matters his how those involved recover from them.

they'll fix it and move on, and that'll likely be the end of it. stuff like this happens all the time, even on exchanges like CME, NYSE, etc. sh!t happens, and if this "scares" anyone out of their bitshares holdings, I'd be happy to buy 'em all up from them, real cheap of course! :D

what I'm actually more concerned about is the "glitch" we uncovered yesterday, which I hope to post about later today...

This is definitely not good. I was to understand the blockchain had resources to avoid this from happening. Witnesses and all.... Research time....

Halting isn't as bad as forking, if it's just a matter of a large transaction backlog when going back online there's nothing to be concerned about.

Wonder if this is related to Steem crashing in price too?!

I don't think so

Some serious BTS dumping was happening last night on Poloniex.

One must wonder about the timing of the dumps and just hours later an unplanned maintenance.

I presumed it was because the HERO was failing at first but maybe this is the cause?

all altcoins are taking a hit right now, I doubt this has anything to do with it.

there will be an investigation/report afterwards

Please let us know when you see that. It will be important to do our best to get it out there once we have it . . . if only to project a professional image. 😉

True hope thing's get sorted quickly.
Just a little speed bump in the road!

HERO isn't failing, perhaps the liquidity isn't great but if you hold HERO tokens they are secure and gaining value each year as designed, regardless of todays network issues.

Oh that is not why I assumed so at all. It was just the timing of the dumps in relation to the HERO news today so I presumed it was not well received.

I am still receiving an error.

Scratch that. It is operational now.

good info please upvote me thank you