Entries (RSS)  |  Comments (RSS)

Archive for the ‘systems administration’ Category

Outgoing blacklists, or, stop the bouncing.

Posted by John Adams on December 12th, 2008

At Twitter, we have many users which sign up for the service and mistype or enter invalid email addresses. Our product group doesn’t want us to use email verification, and for the most part, we cannot because we accept signups via mobile (through the 40404 SMS short-code.) If we bounce too many messages for [...]

Read Full Post  |  Comments

Network performance measurement

Posted by John Adams on November 23rd, 2008

After building a new gigabit network here, we wanted to know exactly what our performance was like. 
I turned to CAIDA, the Cooperative Association for Internet Data Analysis, which has long been a provider of excellent network performance tools. Their research focuses on developing tools to measure the Internet in many amazing ways, such as this map [...]

Read Full Post  |  Comments

Upgrading your home network to Gigabit Ethernet

Posted by John Adams on November 22nd, 2008

This afternoon was a chaotic adventure in upgrading my home network to Gigabit Ethernet. I upgraded my wireless hub from 802.11g to 802.11N, and our internal network from 100mbit to GigE so I can move videos and music around the network faster.
From cabling issues to configuration problems, here’s some tips so that you never have [...]

Read Full Post  |  Comments

ack!

Posted by John Adams on July 17th, 2008

I’ve been experimenting with a few things this week while trying to wade my way through Twitter’s infrastructure. One tool that’s been of extreme help in digging through source code and an extensive set of configuration files has been ack!
It’s the only piece of software I know of that has ‘–thpppt’ as an option (Install [...]

Read Full Post  |  Comments

DNS Patches released today for many platforms

Posted by John Adams on July 8th, 2008

If you’re responsible for DNS at your organization, I urge you to immediately download updates for your DNS servers and patch them, today. Dan Kaminsky and other members of the DNS community announce that they are releasing patches for an extremely serious cache resolver issue impacting many vendors of DNS software, including ISC BIND and [...]

Read Full Post  |  Comments

Day one, Velocity…

Posted by John Adams on June 23rd, 2008

I made it to Velocity around lunch as I was dealing with work business, but so far it’s been pretty decent. Thanks to Jesse Robbins for the invite to speak this evening at Ignite, and for access to the conference.
The day opened (for me, at least) with the Measuring Performance presentation. The general takeaway [...]

Read Full Post  |  Comments

Speaking at Ignite Velocity

Posted by John Adams on June 21st, 2008

I am speaking at Ignite Velocity (which is part of the O’Rellly velocity conference).
I’ll be giving a short presentation on Scaling sites for adult hosting, which will cover technical and operations aspects of building sites to scale for video.
I’ll post up slides shortly.

Read Full Post  |  Comments

Linux find strangeness

Posted by John Adams on May 20th, 2008

I’ve been using the Unix find command for as long as I can remember, and today I found an interesting inconsistency in the way that the implementation of mtime/atime/ctime searches:
Here’s a few examples of how this works:
find . -mtime 0 # find files modified within the past 24 hours
find . -mtime -1 # find [...]

Read Full Post  |  Comments

Scaling and Web Operations at Web 2.0 Expo

Posted by John Adams on April 29th, 2008

I’d like to share with you some takeaways from the Web 2.0 conference, mainly in the realm of scaling and web development.
John Allspaw’s Capacity Planning for Web Operations:
http://www.slideshare.net/jallspaw/capacity-planning-for-web-operations-web20-expo-2008
Why startups need automated infrastructures
This talk was pretty awseome. It dealt with automating operations work.
http://www.slideshare.net/adamhjk/why-startups-need-automated-infrastructures

Scalable Web Architectures: Common Patterns and Approaches (2007)
http://www.slideshare.net/techdude/scalable-web-architectures-common-patterns-and-approaches/
I’m also adding my friend’s talk (Artur [...]

Read Full Post  |  Comments

Linux on a Cisco Switch?

Posted by John Adams on April 14th, 2008

This article at Slashdot is something the Linux community (and I) have asked for for ages. An embedded version of linux capable of running on the network switch itself, delivering content to users directly at the network layer.
I’d always wondered why Cisco hadn’t teamed with Sun during Web 1.0 to put versions of the Netra [...]

Read Full Post  |  Comments