I have been recently working with Sergey Chernyshev, who is the author of ShowSlow, on a new support for uploading HTTP tracing data (collected by the Net panel in Firebug) to the ShowSlow server.

This neat feature simply allows to upload the data in HAR format to the server and share them with others online.

Note that similar thing (uploading and sharing of measured data) is also supported by YSlow and PageSpeed (also using ShowSlow).

Another good news is that ShowSlow is an open source (I love open source!) and so, if you want to keep your data private while having the advantage of simple sharing (and other nice ShowSlow fetures), you can download and install your own copy of ShowSlow server (and also avoid limited upload history on the public instance).

So, read more if you are interested.

Read more...

Page load performance is largely important topic these days and virtually touches every web developer. In this post, I am going to show several page-load cases and describe how to properly read (analyze) data provided by the Net panel in Firebug.

Just to quickly summarize, the purpose of the Net panel is to intercept network communication between a web-page and the server and see what's going on under the hood. All created reports (logs) can be exported by NetExport extension (in HAR format) and there is also an online viewer allowing to preview all exported logs in graphical form.

In order to put together all following examples (HTTP activity logs) I used:
Firefox 3.6 + Firebug 1.5 + NetExport 0.7.

More...

Example 1: Simple Page Load

Let's start with a simple page load.

There are two requests in this log. Elapsed time to get the page document was 16 milliseconds and the load event (the red line) was fired in 58ms. Consequently a 5ms XHR was executed. The total elapsed time (from beginning of the first request till the end of the second/last request) is 408 ms. DOMContentLoaded event (the blue line) was fired in 46 ms.

See a tooltip with detailed timing info.

Example 2: Connection Limit

Each browser has a limit for number of simultaneous connections to the same server when downloading a page. If the limit is reached, other resources have to wait in an internal browser queue till a connection is released. See the following two page logs that show how the situation looks like if there is 8 different images on the page (each image takes ~2.5 sec to download).

#1 Cuzillion (max connections == 6)

  • The limit is 6 in Firefox 3.6 by default, so the first six images start downloading immediately after the page document is available (i.e. DOMContentLoaded event fired in Firefox).
  • The other two images have to wait till there is a free connection (yes, that's the light-brown phase).
  • Existing connections are reused, see there is no green (connection) phase for the last two requests.

#2 Cuzillion (max connections == 2)

  • The other log shows what happens if the limit is set to 2 (network.http.max-persistent-connections-per-server == 2). Notice that every image in this test takes ~2.3 sec to load.

This example comes from Cuzillion (made by Steve Souders).

Example 3: Pipelining

This example uses the same page as the previous example (#2) and compares what happens if pipelining is on.

You can see that using pipelining (network.http.pipelining == true) doesn't help in this case - the page actually takes more time to fire the load event. The first six images are again loaded using six different connection, but 7th and 8th image is downloaded using shared connection. It's not clear which connection is actually shared (there are no APIs that would allow Firebug to know), but it's clear that both last two images were downloaded using the same connection, which increased the total time.

Example 4: Persistent Connections

This test case shows impact of HTTP Connection header. This header is used to tell the server whether an existing connection should be closed or kept alive and wait for further requests (which is usually good optimization). See following log that depicts how it looks if the header is set to Keep-Alive (default in HTTP/1.1) or Close.

There are four requests to load the entire test-page. One for the initial page document and three executed by the page. The Connection header is manipulated for the three requests (file1.php, file2.php, file3.php).

#1 Test page (Connection: Keep-Alive)

  • The first page log shows that only one connection was created to download entire page. All three requests executed by the page reused the initial connection. You can see that there is only one green phase (+ a little bit for DNS lookup).

#2 Test page (Connection: close)

  • In the second log, there is a connection created to get the initial page document and this one is reused by the file1.php request. But as it was mentioned, these three requests use Connection: close request header and so, after file1.php, file2.php and file3.php the connection is closed and new one is must be created if there is a further request.

Example 5: Inline Scripts Block

It's not a secret that inline scripts block download of a page. Let's see following log that depicts how this looks from the network activity perspective.

#1 Cuzillion

  • Note the gap between 3td and 4th request. This is caused by a 5 sec inline script execution.

#2 Cuzillion

  • The second page log is showing what happens if the inline script is moved to the bottom of the page. Note that we have got a shorter loading time.

This example comes from Cuzillion.

Example 6: Redirects

This example shows how redirects looks like when reported by the Net panel.

#1 Final Page (one redirect)

  • The redirect is done by the server that has to figure out what is the target file. If the last / was added, the additional redirect wouldn't be necessary since the server knows that the URL points to a directory.

#2 Final Page (infinite redirection)

  • This scenario shows what happens if the redirect links to itself. In Firefox, the maximum number of redirection is limited to 20 (see network.http.redirection-limit preference)

We have been working with Simon Perkins and Steve Souders on an open format for exporting HTTP tracing information. It's called HTTP Archive (HAR) and we have just finished spec v1.1.

The format is already supported by Firebug (with NetExport extension installed), HTTPWatch 6.2 and also DebugBar 5.3. Further tools like Show Slow and Cesium could be the next.

The key idea is to have a common format for archiving HTTP information that are captured by HTTP sniffers. These logs contain valuable info about page load performance and can be further used to analyze and optimize weaknesses of the monitored page.

There is already a few blog posts about this, explaining all details and so, let me just summarize the most important links here.

Links

HAR Specification

HAR Discussion Group (first post moderated)

HAR Viewer Online preview of *.har files.

NetExport Firebug Extension for exporting HTTP logs.

Recommended Firebug Configuration: Firebug 1.5a26+, NetExport 0.7b5

About a month ago, I wrote a post introducing a HTTP Archive format that is used to export data from Firebug's Net panel.

Since that time we have made further progress and following info could be useful for all who are dealing with HTTP tracing logs and page load performance.

  • NetExport - (requires Firebug 1.4a26 and higher) an extension that allows exporting HTTP tracing data from Firebug. This extension appends a new Export button into Firebug's Net panel toolbar (see the screenshot bellow).
  • HTTP Archive Viewer - online tool that allows previewing of existing logs. The viewer uses the same visual style for visualizing HTTP tracing data as the Net panel. Note that it's possible to compare tracing info generated by multiple pages (which is also something what is planned for Firebug 1.5)
  • HTTP Archive Format - description of the format for exported data (doc updated according to feedback we've got).

NetExport

HTTP Archive Viewer