Mandatory Disclaimer for 3rd party applications (added by Sandbox Interactive)
- This application is a 3rd party project not endorsed or supported by Albion Online and Sandbox Interactive. It is however, as of August 22nd 2017, not explicitly forbidden by us. When using the app, you place your trust entirely into the hands of its developers.
- The associated app, when installed on your computer, gets access to such computer and to traffic that it sends over the internet. This could theoretically be used with malicious intent and is a potential security risk.
- When you us the app while playing the game, you bear the risk that it could be in breach of Albion Online's Terms and Conditions. If it is found to be in such breach, you personally bear responsibility for this. Sandbox Interactive has not audited the app in any way, hence cannot at this stage confirm or deny its compliance with the Terms and Conditions.
We are super excited to announce the initial beta release of the Albion Data Project. The goal of this project is to gather and share publicly realtime information for Albion Online. This is achieved with a downloadable client that monitors network traffic specifically for Albion Online, identifies the relevant information, and then ships it off to a central server which distributes the information to anyone who wants it.
The primary focus of this effort is to gather market data so that people can create tools to show the prices of items or estimate the cost of building items. Included in that is the current gold prices. Ideally we end up with something like EVE Central which was built off a tool very similar to this for EVE.
What to know as a player
At this moment we need people that are willing to help us beta test this. Testing requires downloading, installing, and running our client whenever you are playing Albion Online. There are not currently any major web sites that use this information, but before web sites and applications can use the information they need a supply of information. It's a bit of a chicken or egg kind of problem.
This is a beta release however, so if you do take the time to help by installing and running this client please be patient and report and issues. There will be problems, things will break, but we will do our best to fix things as quickly as possible.
If you would like to help test and begin providing some data download the client from this page: github.com/Regner/albiondata-client/releases
What to know as a third-party developer
On a technical level the distributed client is a Golang application watching network packets, collecting relevant information, and shipping it off to a NATS Server (nats.io/) hosted by us. As a developer you can connect to the NATS Server (nats://public:firstname.lastname@example.org:4222), subscribe to the relevant topics, and do with the messages as you please.
Please note that this is meant to be a firehose of messages. If all you care about is the current-ish prices and want them via an API it is best to wait until someone develops a service, probably backed by this project, that offers the information via an HTTP API. This is meant to back services like that, for services that need the information as quickly as possible, and for services that need all of the information.
A note on duplicate messages. As information comes into the NATS Server it is looked at and deduplicated over a 5 minute window. As a subscriber the goal is that you should only get the same message once every 5 minutes. This is of course open for change as we go however. The reason we are sending the same message at all is two fold.
The simpler reason is that new people connecting to the network may have missed previous messages. Along with that however we don’t have a good way of noticing things like market orders completing. To remove market orders from your application the current best idea around is to keep track of the last time an order was seen, and then after not seeing it for X hours remove it as probably having been completed.
Here are the current topics that as a subscriber you might care about:
We have also broken out the JSON structure for the messages we pass around into a separate Golang package. You can see them here (github.com/Regner/albiondata-client/tree/master/lib) as a reference for your own applications.
While we will do our best not to introduce breaking changes into these message structures we do consider this a beta release and so things may indeed break.
Right now we collect information on two things:
1) Market orders, including their location
2) Gold prices
The Albion Online client receives information on many more things such as the plots at cities, ownership of zones for the world map, and much more. As we are able to identify this information, and get our services more stable, we will be adding more of those kinds of things to the list of what we look for and ship off. Market information and gold prices should give us a solid start though.
If you have any other suggestions for things we should look at tracking please let us know. Preferably as a GitHub issue however here on the forums also works.
Is this allowed
This whole project was born out of someone asking Sandbox Interactive if they were allowed to look at the network traffic for Albion Online. Here is the response MadDave, Technical Lead at Sandbox Interactive for Albion Online, had to that thread:
Our position is quite simple. As long as you just look and analyze we are ok with it. The moment you modify or manipulate something or somehow interfere with our services we will react (e.g. perma-ban, take legal action, whatever).
A huge thanks
While I get to be the one that makes this post, this whole project would not have been possible without the help of a bunch of people working together. Here is a brief list of the people that have actively contributed to the project recently.
@Fastdeath // @pcdummy86
@FoxFour // @regnerba
@gradiuscypher // @0xGradius
@Ultraporing // @Ultraporing
And of course Sanbox Interactive for making Albion Online and actually answering the question of if we are allowed to do this.
I very well may have missed others as well and if i did I am deeply sorry.
This is just the beginning
We have some big plans for this project and are incredibly excited to see what others do with the data that comes from this project. If you’re interested in following along, learning more, contributing, or just chatting with us here are some links that may be of interest:
This will probably become the hub of information for those looking to work with the data provided by the project.
These are the two main repos that power the current project.
If you would like chat with us, or just hang out with others working on fansites and Albion related tools, join us in the above Discord server for Albion Online Fansites. This project mostly lives in the #proj-albiondata channel.
Thank you very much for taking the time to read through this post, a big thank you to those willing to install and test our client, and the biggest of thanks to everyone that has helped contribute to the project.
The post was edited 2 times, last by FoxFour ().