Emergency Server Maintenance

[sw889432]

Maintenance has complete, and the game should be back in operation. If you are still being redirected to the forums, please clear your browser cache. If you need help emptying your cache, visit http://www.refreshyourcache.com/ for more details.

If you notice any new bugs or issue (or old ones that show up again) please submit a new issue on the issue tracker.

Airlines have been reset to accommodate new code changes, including a refactoring of the financial system, and in preparation of IFE/IFS.

---

PREVIOUS POST:


As you may have noticed today, when visiting the website you will have experienced a blank blue page. Also some may have noticed some 504 errors and pages loading slow in the past few weeks.

This is mainly caused by the large amount of data the server has to process and the server is struggling to process that amount. At this point, I believe that this is caused by the recent influx of new users and the the increased amount of active users. Unk and I will be performing some emergency maintenance and server upgrades to solve this issue. We expect this to occur sometime tomorrow. 

In the mean time, you can visit the forums here or join us in the chat while we try to resolve this problem.

Thanks for your patience, and I apologize for any inconvenience. 

---

Fun facts:

Currently have about 660000 active and scheduled flights in the game
Close to 300 airlines
More than 10 million financial transactions
The server process  over 10 million rows of data
About 1/3 of airlines was created in April

[gaff85]

Cloud based auto Sizing
Remove unused airlines, greater than 28 days

[sw889432]

Cloud based auto Sizing
Remove unused airlines, greater than 28 days

Those are in the works.
Cloud based auto sizing isn't implemented for now because the game isn't designed to scale yet, and our provider isn't set up to auto size. With the new servers we are spinning up tomorrow, we are putting different services onto different servers that can scale, and in the future, automatically scale.

[gaff85]

Whats the ETA on game restoration?
Has the game clock stopped?

[sw889432]

Whats the ETA on game restoration?
Has the game clock stopped?

The ETA for restoration is tomorrow evening (past 1700 UTC) as Unk and I have prior commitments and work to attend to first. It is also workers/labour day where I am.
The game is still running, whether successfully or not, I am not sure.

[gaff85]

There needs to be resilience built into the game

At least two load balanced web servers, HA clustered db servers and application servers at a minimum if it is to ever get out of Beta.

[Unknown98]

It is a learning process for all of us. Part of the reason it is still Beta.

I didn't exactly go into this expecting it to get to this point, and now that it's here some things need to be redesigned to accommodate the increased loads.

[sw889432]

There needs to be resilience built into the game

At least two load balanced web servers, HA clustered db servers and application servers at a minimum if it is to ever get out of Beta.

Part of the plan, just whatever we can do with the code and fits the budget and time. The current problem involves both the application core code and the server, and that tuning takes time.

[Unknown98]

The game and forums have been moved to the new servers now. I still have some things to update so we are still a few hours out from having the game back up.

[jbooser84]

The game and forums have been moved to the new servers now. I still have some things to update so we are still a few hours out from having the game back up.

That's great to hear.  Can't wait until it's back up and running.