Comments on: URL Canonicalization: Stop the Dupes! http://benjamingolub.com/2008/04/15/url-canonicalization-stop-the-dupes/ Benjamin Golub's blog Mon, 13 Oct 2008 08:01:20 +0000 http://wordpress.org/?v=2.6.2 By: Url Canonicalization http://benjamingolub.com/2008/04/15/url-canonicalization-stop-the-dupes/#comment-326 Url Canonicalization Thu, 14 Aug 2008 04:30:34 +0000 http://benjamingolub.com/?p=120#comment-326 There is also a way to sort the problem by adding a snippet of code into you .htaccess fil, but I didn't know about these features...<br><br>Thanks for the links and keep up the good articles, this is the 3rd article ive read now and I've learnt something new from all of them =D<br><br>Jordan There is also a way to sort the problem by adding a snippet of code into you .htaccess fil, but I didn’t know about these features…

Thanks for the links and keep up the good articles, this is the 3rd article ive read now and I’ve learnt something new from all of them =D

Jordan

]]> By: Yuvi Panda http://benjamingolub.com/2008/04/15/url-canonicalization-stop-the-dupes/#comment-232 Yuvi Panda Thu, 15 May 2008 01:28:04 +0000 http://benjamingolub.com/?p=120#comment-232 Well, I've been bitten by this too. However, since my dataset was small and performance wasn't an issue, I tried HEADing every url, with the result that quite a few sites don't respond very well to HEADs :( Well, I’ve been bitten by this too. However, since my dataset was small and performance wasn’t an issue, I tried HEADing every url, with the result that quite a few sites don’t respond very well to HEADs :(

]]> By: [scribkin] Tell Me About RSSmeme http://benjamingolub.com/2008/04/15/url-canonicalization-stop-the-dupes/#comment-204 [scribkin] Tell Me About RSSmeme Tue, 13 May 2008 16:29:40 +0000 http://benjamingolub.com/?p=120#comment-204 [...] URL Canonicalization is a fancy term for removing duplicate articles. Without this essential ability RSSmeme would be cluttered with dozens of slightly-different copies of each article. [...] [...] URL Canonicalization is a fancy term for removing duplicate articles. Without this essential ability RSSmeme would be cluttered with dozens of slightly-different copies of each article. [...]

]]> By: Benjamin Golub http://benjamingolub.com/2008/04/15/url-canonicalization-stop-the-dupes/#comment-231 Benjamin Golub Tue, 06 May 2008 20:16:17 +0000 http://benjamingolub.com/?p=120#comment-231 FeedBurner sometimes gives this out; most of the time it doesn't though. It looked to me like maybe a setting in FeedBurner can enable this? I use it if it's available; if not I have no other choice but do follow the redirect to find it. FeedBurner sometimes gives this out; most of the time it doesn’t though. It looked to me like maybe a setting in FeedBurner can enable this? I use it if it’s available; if not I have no other choice but do follow the redirect to find it.

]]> By: smazurov http://benjamingolub.com/2008/04/15/url-canonicalization-stop-the-dupes/#comment-230 smazurov Tue, 06 May 2008 20:10:55 +0000 http://benjamingolub.com/?p=120#comment-230 I remember when looking at google shared feeds, is that 95% of the items have the actual *final* url of the story, under original-id tag. Do you not use that at all in aggregation efforts? I remember when looking at google shared feeds, is that 95% of the items have the actual *final* url of the story, under original-id tag. Do you not use that at all in aggregation efforts?

]]> By: links for 2008-04-25 « Network(ed)News Bookmarks http://benjamingolub.com/2008/04/15/url-canonicalization-stop-the-dupes/#comment-186 links for 2008-04-25 « Network(ed)News Bookmarks Fri, 25 Apr 2008 02:47:43 +0000 http://benjamingolub.com/?p=120#comment-186 [...] benjamingolub.com » URL Canonicalization: Stop the Dupes! When users share from a blog’s old feed while others use FeedBurner and you don’t canonicalize before aggregating, you can’t reliably count how many times a story has been shared. Canonicalizing something means to find the “standard state” of it (tags: programming url canonicalization friendfeed feedburner readburner rssmeme aggregation dupe tinyurl) [...] [...] benjamingolub.com » URL Canonicalization: Stop the Dupes! When users share from a blog’s old feed while others use FeedBurner and you don’t canonicalize before aggregating, you can’t reliably count how many times a story has been shared. Canonicalizing something means to find the “standard state” of it (tags: programming url canonicalization friendfeed feedburner readburner rssmeme aggregation dupe tinyurl) [...]

]]> By: Benjamin Golub http://benjamingolub.com/2008/04/15/url-canonicalization-stop-the-dupes/#comment-227 Benjamin Golub Wed, 16 Apr 2008 04:37:58 +0000 http://benjamingolub.com/?p=120#comment-227 No problem; glad I could help! No problem; glad I could help!

]]> By: Paul http://benjamingolub.com/2008/04/15/url-canonicalization-stop-the-dupes/#comment-226 Paul Wed, 16 Apr 2008 04:08:21 +0000 http://benjamingolub.com/?p=120#comment-226 Thanks for the tip...I just made the switch to <a href="http://www.sixteenseven.com/gReader">gReader Comments</a>. Thanks for the tip…I just made the switch to gReader Comments.

]]> By: Benjamin Golub http://benjamingolub.com/2008/04/15/url-canonicalization-stop-the-dupes/#comment-229 Benjamin Golub Wed, 16 Apr 2008 04:01:11 +0000 http://benjamingolub.com/?p=120#comment-229 I have to disagree; FriendFeed is about discussion within (and extending slightly out of) your group of friends. I'm glad they don't merge everything together but it would be nice to see what other people have to say about a story. I have to disagree; FriendFeed is about discussion within (and extending slightly out of) your group of friends. I’m glad they don’t merge everything together but it would be nice to see what other people have to say about a story.

]]> By: WinExtra » From the Pipeline - 4.15.08 http://benjamingolub.com/2008/04/15/url-canonicalization-stop-the-dupes/#comment-180 WinExtra » From the Pipeline - 4.15.08 Wed, 16 Apr 2008 03:32:37 +0000 http://benjamingolub.com/?p=120#comment-180 [...] URL Canonicalization: Stop the Dupes! :: benjamingolub.com - one of the big problems with aggregator sites that keep running tallies of URLs is duplicate URLs that can occur because of services like tinyurl.com or Feedburner. Ben writes to encourage these types of sites to use URL canonicalization. [...] [...] URL Canonicalization: Stop the Dupes! :: benjamingolub.com - one of the big problems with aggregator sites that keep running tallies of URLs is duplicate URLs that can occur because of services like tinyurl.com or Feedburner. Ben writes to encourage these types of sites to use URL canonicalization. [...]

]]>