Friday, April 14, 2006

Pssst! Book recommendations from LibraryThing

I just launched the new "Pssst!" feature, which examines your catalog against patterns in the catalogs of LibraryThing's other 30,000 users to produce book recommendations just for you. LibraryThing already suggested books on a book-by-book basis, and matched you up with users who had similar libraries. This completes the circle.

To use the feature you need to have cataloged ten books. If you have, check our your recommendations. If you haven't, check out my recommendations—ancient civilization and web design, it got me. (Incidentally, yes I have read Thucydides. I just have another 2,000 books to catalog!)

Recommendations are available in three types:
  • People with your books also have…
  • Similarly-tagged books
  • Most popular books you don't have
In each case, I've divided the recommendations into "fiction" and "non-fiction" (a rough, algorithmically-determined label). You can click a link to exclude books by authors already in your collection, so a mystery buff doesn't get showered with minor Agatha Christie novels.

Needless to say, the point is not commercial. Although you can find commercial links, I didn't add any to the recommendations page. I hope you'll agree that LibraryThing—with no funding and building on a real community—produces recommendations as good or better than the ones you're getting from Amazon, and ones not tilted toward current offerings or what you bought last week.* Community beats commerce, even in commerce.

Let me know what you think here, or discuss it at length on the Google Group.

The back story:

Long-time users may remember a previous feature that also produced book recommendations. I took it down because the math was so complex that it was slowing the site down, even when I required people to wait 20 minutes for the results. This new algorithm is much faster, relying on the existing book-by-book recommendations. (Book recommendations are regenerated on a sliding schedule, at night.) The old feature was also made before the "works system," so it threw up a lot of books already in your catalog. Even so, I want to bring back suggestions focused on most-similar users, if I can do it in a way that doesn't kill the server.

I agonized over the name—Recommendations? Suggestions? I even contemplated "Pimp a Book" (I own the domain). "Pssst!" sounds a little gimmicky, a little "marketing-ish," too "Pssst!®." The deciding factor was length. I wanted to give it its own tab—it's a major feature already, and I have plans to expand it. The other options were just too long.

Lastly, I want or plan to extend the feature in the following ways:
  • A way to mark what you think of the recommendation—good, bad, totally off-the-wall.
  • A way to add a book to your wish list.
  • Tracking the list over time, so you could find out the "new" recommendations.
  • A "why" button. (For example: "Suggested because you own The Hobbit and Sexing the Cherry.") That's very expensive to do for all books at a time. One-by-one, I could "Ajax" the answer in, but so much Ajaxing—people will click "why," "why," "why" like mad—makes me nervous.
Oh, I renamed "extras" to "Tools and Toys." I'll be adding to that tab quite a bit in the coming weeks. Have the cool toys—chicklets, Thingamabrarians, that nifty LibraryThing-Outlook-PDA conversions, etc.—never made it off the blog or Google Group.

*I mourn the fact that my Amazon recommendations have flipped, from obscure Throwing Muses albums (of course, I have all of them, but Amazon don't know that), to baby-care books. O for lost youth!

30 Comments:

Anonymous Anonymous said...

Heh ... so by studiously avoiding adding any books from the "Most popular books you don't have" list we can help preserve our hard-won Obscurity Ratings!

I was bummed to see that I had a half a dozen or so of those on my to-be-read shelves (I don't add any books to my catalog that I haven't actually read), which means that my Obscurity Rating is eventually going to take quite a hit!

- BTRIPP

4/14/2006 10:14 AM  
Blogger Tim said...

For $10, I'll keep the number low for ya ;)

4/14/2006 10:18 AM  
Anonymous Anonymous said...

I like the new Pssst! A comment, bug, and question:

1. One type of book that seems to be showing up a lot on both fiction and nonfiction lists for me are Dungeons & Dragons game books. (I kinda wish they'd be one place or the other instead of at the top of both lists for me.)

2. The new tabs don't appear on the combine books page--it has the old tags with Extras instead of Tools & Toys. (It kept telling me to get Magic of Faerun when I already had it except I really had Magic of Faerûn so I got some practice at combinging books, but lost my Psst! tab in the process).

3. How do I combine 2 books that are the same work, but one of the records has a blank for the author? I have "Player's Handbook: Core Rulebook I (Dungeons & Dragons, Third Edition) by Monte Cook" and Psst! suggests "Player's Handbook: Core Rulebook I (Dungeons & Dragons, Third Edition)" which, hello!, I have... but notice that the Psst! suggestion doesn't list an author. In the book info page it says Author: (none). It should have Monte Cook there. And without an author, I can't figure out how to get the 2 books combined.

I'm really enjoying LibraryThing. Thanks for all your work on it.

4/14/2006 11:26 AM  
Anonymous Anonymous said...

Thanks for the recommendations. Just reading over the list based on my library gave me a good laugh, and reminded me that my library is, um, varied. And I realized that there are some books that I missed cataloging, because they were recommended and I OWN them. Oops.

4/14/2006 11:27 AM  
Anonymous Anonymous said...

Now this is a fun feature....
Like I need more suggestons, to spend more money, for more suggestions...
Pssst! I gonna go broke!!!

davisfamily

4/14/2006 12:02 PM  
Blogger Tim said...

Okay, I returned "Tools and toys" to "extras." That makes it work on 600x800 for me anway. (I'm not sure how many people use that, but It should probably be supported.)

4/14/2006 12:10 PM  
Anonymous Anonymous said...

As a new customer, this is a *very* exciting feature for me, and I'm really glad I chose LibraryThing over the other products available on the market. However, this will *not* do anything to curb my very excessive book habit! *laughing* Please DON'T find an easy, one click method for me to BUY these books on the list from half.com, or I'm so sunk it's not funny! What would be cool, though, seriously, is the ability to be able to click something off the list, or find some way to shunt it off to an alternate list of things that I've borrowed from libraries, so that I can keep track of books I read outside of what I own. Anyway, thank you so much for your hard work.

4/14/2006 1:18 PM  
Blogger Dennis said...

I second Kelliras' question (2).

I'm one of three people with a copy of A Hellenistic Anthology (edited) by Neil Hopkinson, while 4 others have the same book sans editor's name.

There really ought to be a way to combine these. I think it accounts for a number of recommendations of books I already have.

4/14/2006 3:14 PM  
Anonymous Anonymous said...

I notice that some authors whose books I own crop up even when I click the "omit authors" option. At first I thought it was because I owned a non-fiction book and I was looking at the fiction list, or vice versa.

But that doesn't explain why, when I own copies of plays by Shakespeare and Sophocles, other editions of the plays appear (on the fiction list).

Hmm, Elie Wiesel and Boccaccio and Edgar Allan Poe show up as well . . .

4/14/2006 3:44 PM  
Anonymous Anonymous said...

Popular books I don't have: Harry Potter, Harry Potter and Harry Potter.
I know I don't have Harry Potter.
I don't want Harry Potter :-)
I already have about one third of the rest of the list. I should really get to work adding books, instead of browsing other people's catalogues, or hanging around here or in the discussion group.
Great feature!
Cheers,
j.

4/14/2006 4:17 PM  
Blogger Tim said...

Beanrua / "Please DON'T find an easy, one click method for me to BUY these books on the list..."

Sorry. Too late. You know how Amazon has it's pattented "one-click" method. Well, LibraryThing has a no-click method. The books are on their way. Your credit card has been charged.

Dennis: A long time desideratum, and one I'm working on. I have the Hellenistic Anthology too (the Greek and Yellow, right?), although I don't know if I've cataloged it.

Lilithcat: It probably "aliases" the authors on one side only. I'll see what I can do.

Jaydot: It's gonna bug you every time. Just cave and buy the Harry Potters. They're really quite good. (Speaking as a former dismisser.)

4/14/2006 4:51 PM  
Anonymous Anonymous said...

Flat-out marvelous! This is so far beyond even your earlier suggestions that it's stopped being funny. My good intentions have felt the Breath (or hist?) of Doom.

Any bugginess is beside the point. :)

Speaking of 'beside the point,' I'm totally with you on deep/warm browns and reds for any book-and-library related color scheme. To me, it speaks books, intelligence, and sophisticated comfort at once. Keep the design clean, and I don't see any lack of needful 'professionalism' to them.

4/14/2006 6:39 PM  
Blogger Tim said...

Erydice: "I'm totally with you on deep/warm browns and reds for any book-and-library related color scheme. To me, it speaks books, intelligence, and sophisticated comfort at once."

Maybe I should scan an old leather chair and put that up as the color.

Hey, long time no see!

4/14/2006 6:43 PM  
Blogger . said...

http://www.librarything.com/recommendations/BoPeep-simlib-nonfiction-1
[non-fiction excluding authors in my catalogue]

Several Sandra Boyntons (including one I have) and an Enid Blyton novel appear, despite my having both authors represented in my catalogue.

4/15/2006 1:06 AM  
Blogger . said...

Ooh, did it truncate the URL??
Simlibnonfiction

4/15/2006 1:08 AM  
Anonymous Anonymous said...

Tim: sounds perfect!

I know, I've been hiding my head under a rock; but I'm glad to see all the wonderful things emerging - as I am.

(Off to sit in my imaginary old leather chair, with an illusory volume in red!)

4/15/2006 1:16 AM  
Anonymous Anonymous said...

This was funny, I tried the recommendations, told out it to take out all the authors I had, and was left with the recommendation of 3 Roger MacBride Star Wars novels!

:)

bluetyson

4/15/2006 2:01 AM  
Anonymous Anonymous said...

I like the new Pssst! but it's not working as well for me as the older algorithm.
In trying to find new fiction 'authors I don't have', I only get _1_ author & 1 book recommended...
Is it because I've got quite a few 'completist' authors in my bookshelves? I've noticed at a book level that sometimes exluding an author results in no list appearing for these type of authors.
I'd tried the older algorithm a while ago and was impressed at some of the new authors recommended that I'd not read. I'm now reading them (library books so not yet loaded). Thanks for that!
....However I'm surprised to not have these authors in the new list.
Apart from that, it's an excellent idea, and I'm looking forward to when we can mark the recommendation as good/bad/etc.
And thanks again for one of the most facinating uses of my time the past few months! ryn

4/15/2006 4:06 AM  
Blogger bibliobibuli said...

*sigh* (after lugging home my impulse buys from bookshops two days running) do you think i need MORE recommendations? i need a twelve-step plan ...

just kidding - it's really fun to see what comes up (many of the books that come up are in my library in my head - read and part of me but not on my shelves for one reason or another) and thank you for the hard work you put in improving the site

4/15/2006 7:57 AM  
Anonymous Anonymous said...

Hey Tim,

Since you are using the book recommendations to get the suggestion lists, is there a way we could exclude a book from our suggestion lists? Or perhaps base it on "If rated, any rating below 2" does not go into the suggestion list? I've got a few books I'd rather not keep following, but I bought based on author.

4/15/2006 8:13 AM  
Blogger Tim said...

ryn_books and others who had few books: I made it give 500 suggestions, and give the top 100. If you remove authors you already have, it's 500 minus those authors. I upped it to 1500 now. Let me know if you get more results, and if they are good.

4/15/2006 12:24 PM  
Blogger Tim said...

Good as I think it is, the underlying math of the other algorithm was more persuasive. I may bring it back. But you'll have to wait for the results. It's a bear!

4/15/2006 12:25 PM  
Anonymous Anonymous said...

It's still not properly excluding authors already in my catalogue when I click the link (see for example http://www.librarything.com/recommendations/bduguid-simlib-nonfiction-1, which features Andrew Vachss, Dr Seuss, Nick Hornby, W S Burroughs etc, all in my collection and none of them non-fiction). Also, it still focusses on popular genres rather than those that are more prominent in my collection (possibly because the tag-list for non-fiction is limited?) I'm afraid to say that Amazon(.co.uk) currently gives me far more relevant recommendations ...

4/15/2006 3:06 PM  
Anonymous Anonymous said...

speaking of book covers, will it ever be possible to choose an amazon cover without having to change the isbn?

4/16/2006 7:33 PM  
Anonymous Anonymous said...

Like lilithcat and bopeep, I have an author-exclusion bug. (Fiction list, LT name 'tikitu', it's a Dave Eggers -- not a title I own, but I've checked both it and mine are going to the same author page.)

Regardless, this is lots of fun! The "why this one?" feature would be great.

4/17/2006 1:01 PM  
Anonymous Anonymous said...

(Sorry, that's "people with your books also have: fiction" not tags or popularity.)

4/17/2006 1:04 PM  
Anonymous Anonymous said...

A strange bug in "Psst!" has cropped up over the weekend (or perhaps a bug elsewhere is reflected there). My top simlib-fiction recommendation is now the cryptic "no title", by no author (catalog number 7518). This mysterious volume is given a LC number, though, and googling that turned up, of all things, a LibraryThing page (!) for _Ender's Game_ by Orson Scott Card (which is in my library). Only the version of that page in Google's cache has the LC number, though; it has disappeared from the current version, perhaps related to the appearance of the mysterious No Title.

What's going on here?

4/17/2006 6:27 PM  
Anonymous Anonymous said...

Can we have a simple feature that shows us whether a book is say, out on loan, to a friend, or not in the catalogue? (Like a proper library! :-> ) Right now I'm just using the comments section to let me know which of my books are currently held by my friends. I'm guessing all you have to do is add another field. Thanks, Librarything is great!

4/17/2006 6:27 PM  
Anonymous Anonymous said...

anonymous,

with regards to on loan it will work much better if you use tags rather than comments. This is because you can search tags.

You could use tags such as on_loan_to_fred and on_loan_from_anna. You could then search for on_loan_to_fred for just fred or use a wildcard (on_loan_to*) for all books you have on loan to anyone.

It works, it is very lightweight, and I would prefer Tim to work on core cataloguing functionality before adding in loans functionality.

4/18/2006 3:00 PM  
Anonymous Anonymous said...

why bedevil this site with dungeons and dragons. this is a game not a literary endeavor. go back to gamers, thou!

5/30/2006 3:39 PM  

Post a Comment

<< Home