Kickstarter Tumblr Art Club. Film TV Games. Fortnite Game of Thrones Books. Comics Music. Filed under: Tech Facebook. Mark Zuckerberg shares pictures from Facebook's cold, cold data center New, 35 comments. Linkedin Reddit Pocket Flipboard Email. He's right, although it certainly doesn't look like a particularly happy sci-fi movie — more of a dystopia. Next Up In Tech. Sign up for the newsletter Verge Deals Subscribe to get the best Verge-approved tech deals of the week.
Just one more thing! Please confirm your subscription to Verge Deals via the verification email we just sent you. Email required. By signing up, you agree to our Privacy Notice and European users agree to the data transfer policy.
Loading comments For more information on cookies, see our Cookie Policy. Know how your site or web app is performing with real user insights. Pinpoint the root cause down to a poor-performing line of code. Integrated, cost-effective, hosted, and scalable full-stack, multi-source log management. Quickly jump into the relevant logs to accelerate troubleshooting. This article takes a look at some of the software and techniques they use to accomplish that. Before we get into the details, here are a few factoids to give you an idea of the scaling challenge that Facebook has to deal with:.
Sources: 1 , 2 , 3. Check out this blog post to learn more stats on the most used social media platforms. In some ways Facebook is still a LAMP site kind of which refers to services using Linux, Apache, MySQL, and PHP, but it has had to change and extend its operation to incorporate a lot of other elements and services, and modify the approach to existing ones.
But enough of that. Memcached is by now one of the most famous pieces of software on the internet. Through the years, Facebook has made a ton of optimizations to Memcached and the surrounding software like optimizing the network stack.
Facebook runs thousands of Memcached servers with tens of terabytes of cached data at any one point in time. PHP, being a scripting language, is relatively slow when compared to code that runs natively on a server.
This has allowed Facebook to get much more out of its web servers since Facebook relies heavily on PHP to serve content.
A small team of engineers initially just three of them at Facebook spent 18 months developing HipHop, and it was used for a few years. It has a ton of work to do; there are more than 20 billion uploaded photos on Facebook, and each one is saved in four different resolutions, resulting in more than 80 billion photos. As we mentioned previously, Facebook users upload around , photos every minute which makes it 2, photos per second. BigPipe is a dynamic web page serving system that Facebook has developed.
For example, the chat window is retrieved separately, the news feed is retrieved separately, and so on. The key to the migration was a specialized Amazon service known as the Virtual Private Cloud. The migration took about a year, and although it was a huge undertaking, it was handled by a small team.
Eight engineers oversaw Instagram's infrastructure in , a number that has since expanded to Cabrera says the team spent the better part of a year preparing for a month of data migration. Since , Instagram had run atop Amazon EC2, the seminal cloud computing service that lets anyone build and run software without setting up their own computer servers. To seamlessly move Instagram into an east coast Facebook data center--likely the one in Forest City, North Carolina--Cabrera's team first created what essentially was a copy of the software underpinning the photo-sharing service.
Once this was up and running in the Facebook facility, the team could transfer the dataincluding those 20 billion photos. The process was trickier than you might expect. It involved building a single private computer network that spanned the Facebook data center and the Instagram operation on Amazon's cloud--the best way of securely moving all of the data from one place to another--but the team couldn't build such a network without moving Instagram to another part of the Amazon cloud.
In other words, Krieger's crew had to move Instagram once and then move it again. First, they moved it into Amazon's Virtual Private Cloud, or VPC , a tool that let Krieger and his crew create a logical network that reached beyond Amazon into the Facebook data center.
Creating this network was particularly important because it gave Facebook complete control over the internet addresses used by the machines running Instagram.
0コメント