Hornet reduces Apache Cassandra cluster storing requirements by 50% with DataStax

Hornet reduces Apache Cassandra cluster storing requirements by 50% with DataStax

Hornet was a social networking neighborhood and application your gay society. This has more than 30 million customers globally and provides a community house base that’s available anytime and anywhere. Hornet has transformed into the top homosexual software in region such as for example France, Russia, Brazil, Turkey, and Taiwan, and is also fast expanding their large consumer base across Europe plus in the United States.

Created in 2011, the group at Hornet relies internationally across southern area Africa, america, The Czech Republic, and Hong-Kong. Hornet needs to help a rapidly raising neighborhood and ensure that solutions can be found, receptive, and secure.

50per cent decrease in storage specifications


The Challenge

The leadership personnel at Hornet planned to offer the society that had developed across the software, increasing into new treatments and help strategies that could let consumers connect with each other around provided interests, stores, and information. This intended taking a look at how many of the app’s preferred characteristics functioned.

We had to reduce the amount of information put and develop all of our capabilities as part of our very own upgrade method. With assistance from DataStax, we went from around sixty percent capability on our texting cluster to simply under 30 % capacity. That’s an enormous performance achieve that individuals were able to provide.

Matthew Hirst Mind of Machine Part Manufacturing at Hornet

Matthew Hirst, Head of host area Engineering at Hornet, led the group tangled up in this job. “We projected that the number of emails that individuals might be support would increase by around 50 %, and alongside the continuous development in the number of people utilising the software, that could become an issue in the future. We knew we’d to help make some modifications to how exactly we maintained all of our facts over the years.”

With a give attention to community development and more discussions happening, the Hornet group knew they will have to have a look at scaling in the existing messaging groups. Hornet have applied Apache CassandraTM formerly, but this is a version that expected an update. “Cassandra ended up being what we should originally opted for the texting cluster, and it also functioned fantastically for the. We had no recovery time and it just worked. However, that suggested this was indeed set up for some time, and in addition we hadn’t updated our execution. Alongside this, we considered our very own storage space and we also are continuing to scale-up the quantity of data that we have. That has been becoming an issue also, specifically in line with the progress programs we’d. We know we must do something avoiding issues in the future,” demonstrated Hirst.

A Better Solution

Hirst worked with Nate Mitchell, Lead DevOps professional at Hornet, how the group would means the project. Step one was to choose the best asking help for any improvement. Hirst and Mitchell looked to DataStax for services.

“whenever we talked about this making use of Cassandra neighborhood, there is some consistent feedback on speaking with the group at DataStax. The team there has supported a few of the premier implementations worldwide, so they really have actually a lot of expertise in coping with problems like ours. While doing so, these people were approachable right from the start,” revealed Mitchell.

DataStax assisted the Hornet staff with creating the upgrade method including optimizing their method of controlling clusters. DataStax furthermore provided consulting advice on tips keep track of the outcomes regarding the move, so your group could describe that it have used best approach.

“We got used some design conclusion in past times that produced feel formerly, even so they did not match precisely what the organization wished to accomplish as time goes on. Included in the inform to Cassandra on all of our messaging group, we had been capable improve the efficiency around how we were able to archive emails. Not just would this provide a decrease in the general level of space that individuals would have positioned, nevertheless would let us show most emails between customers as regular,” put Mitchell.

The Outcome

Adopting the consulting classes, the Hornet professionals caused DataStax to implement the improvement and management adjustment successfully. This was done in a phased method, utilizing the newsfeed cluster updated very first, accompanied by the texting cluster. This allowed the Hornet team to advance products during the correct rate on their behalf.

“We is a small team, so obtaining the proper suggestions and assistance easily accessible while in the migrations helped you to achieve everything we need. We furthermore experienced your group at DataStax ended up being committed to our achievements,” said Hirst.

The Hornet team in comparison the strategy before and after the migration and got happy with the results. “We could attain a 50 per cent lowering of the volume of information that people must store total – this is certainly a giant preserving for people as a company, and in addition it helps us to support the lasting plans we now have as a business around extra area communication and developing. We completed the migrations effectively without downtime for consumers, we are today on a version of Cassandra that can supporting our very own development successfully better in to the upcoming, and now we have actually that lasting help from DataStax accessible to us whenever we might need it too,” included Hirst.