Syndication Aggregation

Web Architecture and Information Management [./]
Spring 2009 — INFO 190-02 (CCN 42509)

Erik Wilde, UC Berkeley School of Information
2009-04-08

Creative Commons License [http://creativecommons.org/licenses/by/3.0/]

This work is licensed under a CC
Attribution 3.0 Unported License
[http://creativecommons.org/licenses/by/3.0/]

Contents E. Wilde: Syndication Aggregation

Contents

E. Wilde: Syndication Aggregation

(2) Abstract

Feeds are useful as information sources adhering to a standardized format, but they usually have a single source. In a larger picture of information flows on the Web, the question is how feeds can be handled more efficiently and flexibly. This includes questions such as load balancing and user statistics, but also more complex scenarios such as aggregating (and maybe even filtering) feeds. Since feeds use a standardized data format, such repurposed information again can be published as a feed, creating a flexible architecture of feed-based information dissemination, allowing an arbitrary number of feed aggregation steps.



E. Wilde: Syndication Aggregation

(3) Feeds as Data Sources



Syndication Aggregation

Outline (Syndication Aggregation)

  1. Syndication Aggregation [7]
    1. FeedBurner [5]
  2. Aggregating Delicious Tags [5]
Syndication Aggregation E. Wilde: Syndication Aggregation

(5) End-User Aggregation

feed-icon.png
<link rel="alternate" type="application/rdf+xml" title="…" href="…" />
<link rel="alternate" type="application/rss+xml" title="…" href="…" />
<link rel="alternate" type="application/atom+xml" title="…" href="…" />


Syndication Aggregation E. Wilde: Syndication Aggregation

(6) Aggregation Intermediaries



FeedBurner

Outline (FeedBurner)

  1. Syndication Aggregation [7]
    1. FeedBurner [5]
  2. Aggregating Delicious Tags [5]
FeedBurner E. Wilde: Syndication Aggregation

(8) Fixing Feeds

Cleaning Up Feeds

FeedBurner E. Wilde: Syndication Aggregation

(9) Load Balancing

Providing Feed Load Balancing

FeedBurner E. Wilde: Syndication Aggregation

(10) Statistics/Analytics

Providing Feed Statistics

FeedBurner E. Wilde: Syndication Aggregation

(11) Query Capabilities

  • Feed technology is still evolving
  • Feeds are mostly viewed as ordered by time
    • allows optimization for accesses and caching
    • makes it hard to use feeds for non-timed information
  • Feeds could be ordered by any sort key
    • makes server-side feed processing much more expensive
    • enables customized feeds that are processed on the server-side


FeedBurner E. Wilde: Syndication Aggregation

(12) Supporting Queryable Feeds

Supporting Queryable Feeds

Aggregating Delicious Tags

Outline (Aggregating Delicious Tags)

  1. Syndication Aggregation [7]
    1. FeedBurner [5]
  2. Aggregating Delicious Tags [5]
Aggregating Delicious Tags E. Wilde: Syndication Aggregation

(14) Using Feeds for Data Management



Aggregating Delicious Tags E. Wilde: Syndication Aggregation

(15) Delicious Tags as Feeds

Delicious Tag Page and Feed Link

Aggregating Delicious Tags E. Wilde: Syndication Aggregation

(16) Google Reader Feeds

Feeds Republished through Google Reader

Aggregating Delicious Tags E. Wilde: Syndication Aggregation

(17) Google Reader Widgets

        <table>
            <thead>
                <tr>
                    <th>Feed Roll</th>
                    <th>Feed Items</th>
                </tr>
            </thead>
            <tbody>
                <tr>
                    <td valign="top">
                        <script type="text/javascript" src="http://www.google.com/reader/ui/publisher-en.js"></script>
      <script type="text/javascript" src="http://www.google.com/reader/public/javascript-sub/user/16601496766743088901/label/delicious REST?callback=GRC_p(%7Bc%3A%22gray%22%2Ct%3A%22My%20%5C%22delicious%20REST%5C%22%20Feed%20Roll%22%2Cb%3A%22true%22%7D)%3Bnew%20GRC"></script>
                </td>
                    <td valign="top">
                        <script type="text/javascript" src="http://www.google.com/reader/ui/publisher-en.js"></script>
                        <script type="text/javascript" src="http://www.google.com/reader/public/javascript/user/16601496766743088901/label/delicious REST?n=10&callback=GRC_p(%7Bc%3A%22gray%22%2Ct%3A%22%5C%22delicious%20REST%5C%22%20via%20dret%22%2Cs%3A%22true%22%2Cb%3A%22false%22%7D)%3Bnew%20GRC"></script>                </td>
                </tr>
            </thead>
        </table>


Aggregating Delicious Tags E. Wilde: Syndication Aggregation

(18) Explaining Delays

Feed Publishing Pipeline

E. Wilde: Syndication Aggregation

(19) Feeds as Data Containers



2009-04-08 Web Architecture and Information Management [./]
Spring 2009 — INFO 190-02 (CCN 42509)