{"id":283,"date":"2009-05-25T09:12:32","date_gmt":"2009-05-25T16:12:32","guid":{"rendered":"http:\/\/miriamposner.com\/blog\/?p=283"},"modified":"2009-05-25T09:12:32","modified_gmt":"2009-05-25T16:12:32","slug":"dapper-create-an-rss-feed-for-sites-that-dont-have-one","status":"publish","type":"post","link":"https:\/\/miriamposner.com\/blog\/dapper-create-an-rss-feed-for-sites-that-dont-have-one\/","title":{"rendered":"Dapper: Create an RSS feed for sites that don&#8217;t have one"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"alignleft size-full wp-image-284\" title=\"picture-12\" src=\"https:\/\/miriamposner.com\/blog\/wp-content\/uploads\/2009\/05\/picture-12.png\" alt=\"picture-12\" width=\"214\" height=\"61\" \/>It seems like most sites offer RSS feeds (a method of subscribing to new postings), but every so often I&#8217;ll run into a site that doesn&#8217;t, but should. For example, say you want to be notified every time a certain company posts a new job listing, or every time a library adds a book on a certain topic.<\/p>\n<p>For those situations, you may find <a href=\"http:\/\/www.dapper.net\/dapp-factory.jsp\">Dapper<\/a> useful. Dapper is part of a new breed of Web ventures called (unpleasantly enough) &#8220;scrapers&#8221; &#8212; they scrape data from other sites and turn it into usable chunks of information that you can manipulate.<\/p>\n<p><!--more--><\/p>\n<p>I like Dapper because it&#8217;s very effective and easy to use. I used it because I wanted to create an RSS feed of movies I added to my list on the movie social-networking site <a href=\"http:\/\/flixster.com\/\">Flixster<\/a>. This may seem weird, but I wanted to create a WordPress sidebar widget that lists movies I&#8217;ve just watched. Flixster offers its own widget, but it&#8217;s hideous:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-286\" title=\"picture-2\" src=\"https:\/\/miriamposner.com\/blog\/wp-content\/uploads\/2009\/05\/picture-2.png\" alt=\"picture-2\" width=\"201\" height=\"145\" \/><\/p>\n<p>Yuck. Flixster doesn&#8217;t have an RSS feed of your data, so using Dapper&#8217;s Dapp Factory, I specified which types of data I wanted, gave each type a name, and grouped them together. Dapper did a really remarkable job of deducing which types of data were similar. (From reading other, older posts about Dapper on the Web, I gather that it&#8217;s gotten much more effective in the last year or so.)<\/p>\n<p>Once you&#8217;ve scraped the data you want, you can get it from Dapper in a number of forms: RSS, XML, Google Gadget, iCalendar, Netvibes, and Image Loop. Dapper can also create its own widget for you automatically.<\/p>\n<p>WordPress has its own simple RSS widget, so I just entered the address for my Dapper-created RSS feed, and you can see the results at right. It&#8217;s interesting to think about other applications for this. Some companies are extremely nervous about the possible effects of data-scrapers, and <em>Wired<\/em> has an <a href=\"http:\/\/www.wired.com\/techbiz\/media\/magazine\/16-01\/ff_scraping\">interesting article<\/a> detailing the various ways data scrapers could be abused, or could simply violate other companies&#8217; intellectual property.<\/p>\n<p>There are other ways to create an RSS feed. <a href=\"http:\/\/pipes.yahoo.com\/pipes\/\">Yahoo Pipes<\/a> offers a greater degree of flexibility, but it requires more programming expertise. <a href=\"http:\/\/kapowtech.com\/index.php\/products\/overview\">Kapow<\/a> features a service similar (to my layperson&#8217;s eyes) to Dapper, but is aimed at companies rather than individuals. <a href=\"http:\/\/www.feedyes.com\/\">FeedYes<\/a> did a nice job creating an RSS feed from my Flixster data, but it doesn&#8217;t offer as many output options as Dapper. <a href=\"http:\/\/www.feed43.com\/\">Feed43<\/a> can also create an RSS feed, but the process is a little more complex.<\/p>\n<p>I found the <a href=\"http:\/\/www.dapper.net\/dapp-factory.jsp\">Dapp Factory<\/a> to be the easiest, most intuitive solution to my specific problem. It&#8217;s free, no registration required.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>It seems like most sites offer RSS feeds (a method of subscribing to new postings), but every so often I&#8217;ll run into a site that doesn&#8217;t, but should. For example, say you want to be notified every time a certain company posts a new job listing, or every time a library adds a book on [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[85,86,84],"class_list":["post-283","post","type-post","status-publish","format-standard","hentry","category-tools","tag-data-scraper","tag-feeds","tag-rss"],"_links":{"self":[{"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/posts\/283","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/comments?post=283"}],"version-history":[{"count":6,"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/posts\/283\/revisions"}],"predecessor-version":[{"id":291,"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/posts\/283\/revisions\/291"}],"wp:attachment":[{"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/media?parent=283"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/categories?post=283"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/miriamposner.com\/blog\/wp-json\/wp\/v2\/tags?post=283"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}