Where's Steemit.Chat???

in #steemitchat8 years ago (edited)

Update5 - [Nearly There]

The brave among you can try the new server at: http://52.15.210.158/home

Not this is not ssl certified yet and may need to get reset but it'll scratch the itch haha. Once the DNS updates I can get us back to happy htps and steemit dot chat domain.

UPDATE4 [9:34pm EST]

Database is being restored on the new server. Still waiting for the DNS to update (if it's not one thing it's another, eh?) but it should all come together nicely. I'll keep on till it's running again.

UPDATE3 [5pm EST]

New server is up and running. Just waiting for the DNS to redirect so I can renew certs.

UPDATE2 [3pm EST]

I have box access again and am doing a DB backup before bringing things back on line. I have been in communication with @gandalf about how to prevent an outage like this in the future. We have a plan and with the funds from this post we can make it happen. We should be back up in an hour or so and performance will be addressed shortly there after. It may require some restarts but I'd like to get things smooth again.

UPDATE:

Looks like a network card failed in or near the server. For those curious when it went down we were processing 45 Gigabytes of messages per day for about 12k users. When we migrated to this server it was around 500 Megabytes a day for around 4000 users. While we've tripled in size since then I suspect the real growth is in the active users versus those that have made accounts and never came back.

To that end once I get box access again I'll be migrating the back end database to enterprise grade hardware (AWS EBS) that can scale with some real steem!

Hey folks,

The server has been straining under the influx of new users and yesterday gave up. I am working with the service provider to get it back online enough for me to migrate it to a more powerful server that can better handle the load and scale for future load.

My apologies for the down time. We will work to restore service ASAP.

Kind Regards,

James aka Riverhead.

Sort:  

Thank you @riverhead for all the help and hardwork you put into running the platform! Steemit couldn't have gotten this far without your service to the community!

Damn, that's a hefty comment reward ! He he, thank you both for keeping us updated.

45 Gigabytes of messages per day!! This is super impressive! I haven't been brave enough to try the not ssl certified yet and I'll be waiting for it.

Take care James! Have fun all the while!

Been a bit crazy for us but oh well :D

It is actually a great problem to have. It means that everyone is knocking on our door! Thank you for all your help!

Here is the LIVE feed at all the people trying to get Steemit accounts.

Thanks for the notes folks and the votes. Helps pay for our new upgraded hardware :D. I've added some numbers to the update.

I have no problem contributing 100% upvote to this post, and your comment @riverhead - most of us depend on steemit.chat and I'm glad it went down temporarily for you to generate some funds to get it back up even stronger. :)

i-will-be-back.jpg

thanks for sharing this info....

I love how Steemit staff engage with the community, especially in times like this. It is great to see that they view steemers not only as users, but also as members of this warm community. It is not hard to see that they work hard to make Steemit a better place! :) Thank you @riverhead

"45 Gigabytes of messages per day for about 12k users"
What does that even mean ? 45gb that's gotta be the whole DB

Whoa thats huge amount of data per day

Thank you for the update. As a newcomer, a minnow only 7 days old, I am trying to learn the ropes. I was afraid that I was doing something wrong due to which I was unable to get on the chat.
It is but natural to face such growth issues when the popularity rises fast and outpaces infrastructure. The exponentially growing popularity shows how great a job all of you at Steemit are doing! Kudos. Following you.

Am more into wildlife and nature photography as well as travel. I would be honored if you see some of my work and provide your valuable comments.

Regards,
A minnow (7 days and counting)
minnow.jpg

Thats a great piece of information. Thanks or sharing it

cant wait :)