Monday, December 03, 2007

Better at what we do best

We've introduced a series of improvements to LibraryThing's core strength—high-quality book cataloging.

Detail pages and edit pages. We're replaced the previous detail and edit pages with more attractive and functional ones. That's an edit page over on the right. For a detail page, check out my copy of my the obscure-but-wonderful*, Alexander the Great and the Logistics of the Macedonian Army.

Employing a simple tabbed interface, the new detail pages cover both the "work" level and the individual book level. The latter has been sorely lacking.

Multiple authors, roles. When it comes to cataloging our weakest point was always our handling of "secondary" authors—illustrators, translators, editors and the like. Doing them better has been one of the most insistent requests.

We've got a real system now. Books added today come with secondary authors and author roles built in. We've set down a small number of preset "roles," such as Editor, Translator, Photographer and so forth—based on Amazon's preset roles—but all roles are editable. In time, these roles will be spread throughout the system, so that the author page for someone like Steven King will include not only his own works, but collections he appears in. Translators in particular will finally get their due.



For now, enhanced author and role information is available only for newly-added books. As the system is firmed-up we will begin allowing members to "upgrade" existing records, with multiple authors as well as other cataloging enhancements.

New fields. So far, we're releasing only two new fields. The first is for the number of copies, in case, like I, you have 500 copies of your wife's novel, resisting relocation in the foyer. The second is the much-anticipated "private comments" field. Go ahead, pour your hearts out. The field is only viewable when you are signed in.

We're starting with two, but we have many more waiting in the wings, including fields for edition, publisher, place of publication, binding, physical size and weight, list price—even OCLC number and ISSN. Casey and I spent a lot of time figuring out what more we can squeeze from library data, and from Amazon too. (Did you know, for example, that all library data records declare whether or not they are a Festschrift, but there is no standard way of indicating a CD?)

New Libraries. We've been unveiling libraries slowly. By New Years, however, we will have almost 700 libraries. Including among these will be many outside of English-speaking countries, and including books in non-Latin scripts, such as Arabic, Korean and Armenian. Library systems are notoriously twitchy with non-Latin data, and between LT employees we cover nothing beyond Greek. If you're interested in helping us test these systems, we'd love to hear it.

New Languages. LibraryThing is already available in more than a dozen languages. We're about to release sixteen more. They are:
Afrikaans, Arabic, Armenian, Chinese (simplified), Chinese (traditional), Farsi, Hebrew, Hindi, Japanese, Korean, Macedonian, Polish, Russian, Serbian, Tagalog, Urdu
Some of our existing translations have done well—German, Dutch, Welsh—while others—Basque, Latvian—have languished. I think I see now that the key ingredient is a small cadre of zealots willing to do enough initial work that subsequent, interested but less-daring helpers can carry thing the rest of the way. If you're interested in helping out on one of these languages, let us know. We'll give you a special key in.

MARCThing. Underneath many of our improvements is an exciting new package we're calling MARCThing. Developed by our own Casey Durfee, MARCThing is a complete, self-contained and largely idiot-proof way to access and parse library data. We're going to making it available for non-commercial use and extension. We expect lots of interesting things to come of it.

I've asked Casey to write up a post on MARCThing over on the Thingology blog. It'll be there in a sec. Check it out.

Talk about it. Yesterday was Götterdämmerung for everything new. So much changed so completely that a lot ended up broken. For that we apologize. Chris and I are very grateful for the flood of bug reports, suggestions, criticisms and encouragement. That thread is threatening to hit 200 posts, so I'm starting a new thread for lingering issues (there are a few) and other topics related to this blog post. Of course, you can also comment on this post. Blog posts are a lousy place for bugs, but they're a great place for more detailed questions, disagreements and so forth.

Future steps. In the next week we'll be unveiling the other new fields, and building a "data-enhancement" option for older records. After that, the path is clear for collections. (But don't shoot me if I slip a Secret-Santa feature in this week.)

Final thoughts. We've undertaken to improve this aspect of the site despite some contrary advice—that most people don't care about getting the data right, and that we need to focus on the purely social parts of the site. After all, we're already the best at this side, so why spend time and money to get better?

Although, with cataloging improved, we intend to turn our attention to better UI—such as collections—and to improved social features, we feel that LibraryThing isn't MySpace—that content and conversation are inextricably linked. As Tim O'Reilly recently put it in an interview, LibraryThing is one of a number of sites that provide different, interesting takes on the "social graph." You don't get to interesting relationships around books without making the book-side as powerful and flexible as can be.


*And, on LibraryThing, insanely over-promoted!

Labels: , , ,

49 Comments:

Anonymous Anonymous said...

Yay, author improvements!!!

12/04/2007 1:39 AM  
Anonymous Anonymous said...

When you click on the book details tab after looking at the work details, or vice versa, the other tab disappears and you can no longer look at it.

12/04/2007 2:09 AM  
Anonymous Anonymous said...

This is awesome. Even if you swore blind to have collections come out first instead! But I can see why the deeper database changes should come first so you're forgiven. :)

12/04/2007 2:54 AM  
Anonymous Anonymous said...

I care about getting the data right!!! So my biggest gracias to U guyzzz. Although it WILL mean a re-flapping-through of my library while searching for the details. BTW that book surely seems interesting...

12/04/2007 2:55 AM  
Blogger boz said...

This comment has been removed by the author.

12/04/2007 3:19 AM  
Blogger boz said...

This comment has been removed by the author.

12/04/2007 3:33 AM  
Anonymous Anonymous said...

Woooooow! Private comments... I never really thought about that before, but now I realize just how many times I've wanted to put something in about certain books but couldn't/didn't, because it was more personal then anything I'd want people to see. So yay!

12/04/2007 4:44 AM  
Blogger Kristihern said...

Lovely, lovely database changes! The pages are more elegant and more usable, too. Your examples - hilarious.

Social aspects of LibraryThing? Sorry, I hadn't even noticed them, coming, as I did, from Readerware.

12/04/2007 5:46 AM  
Anonymous Anonymous said...

I like your attitude! My book catalog is the main reason I'm here, even though I really enjoy the social aspect too. Keep making the book stuff better, please. (Think anthologies...)

12/04/2007 6:19 AM  
Anonymous Anonymous said...

"(Did you know, for example, that all library data records declare whether or not they are a Festschrift, but there is no standard way of indicating a CD?)"

Have you had a look at the Physical Description Fixed Field (007)? A sound recording on compact disc would be coded sd|f (where s=sound recording; d=disc; |=undefined; f=1.4 m. per sec.).

It's obscure to the non-cataloguer, but then so is looking for 1 in 008/30 for a Festschrift.

12/04/2007 7:42 AM  
Anonymous Anonymous said...

Thanks for the laugh in your example of private comments. May be the only one I get today.

To reiterate.. awesome, and gracias.

12/04/2007 8:19 AM  
Anonymous Anonymous said...

It looks fantastic! Thank you! One question: When will the improved author fields be added to the manually-added book page?

12/04/2007 9:16 AM  
Anonymous Anonymous said...

Thank you for the improvements re: multiple authors. Looking forward to the upgrade of books entered before this. A case in point: Revolting Librarians was co-edited by Celeste West and Elizabeth Katz, yet Katz gts the main billing. As West's partner, I know that she did most of it, wrote the introduction, and was Booklegger Press, the publisher. She has written other books, Katz none, and West should be seen as the main "author." This needs to be modified asap.

12/04/2007 10:03 AM  
Blogger Alexander said...

I'm interested in helping with Farsi. I should point out, however, that in English the language is called Persian. "Farsi" is the Persian name for Persian, as Deutsch is the German name for German.

12/04/2007 11:12 AM  
Blogger Lilithcat said...

You (that's the second person plural "you") never cease to amaze me. It's not merely that LT gets better every day. It's the fact that you are constantly seeking new ways to improve, and that you think about what the changes mean for the site and its users before you make them. No throwing in the latest bells and whistles just because they are the latest.

Your responsiveness and transparency are models, and it's a pity more websites don't copy them.

And all this for just $25*, forever.

*Some of us were smart/lucky enough to get in on LT when it was $10 for a lifetime membership! So we get bragging rights, too. ;-))

(P.S. I'm a big fan of more and more accurate cataloguing data, even if I'm not a librarian nor am I playing one on T.V.)

12/04/2007 11:46 AM  
Blogger Sheila said...

ieJust added two new books, and I love the new appearance and ease of use. Handling of secondary authors, editors and illustrators is excellent! Eventually I would like to put illustrator's names on all our picture books.
Thank you, once again!

12/04/2007 11:49 AM  
Anonymous Anonymous said...

Thank you from someone who does "care about getting the data right".

12/04/2007 12:20 PM  
Blogger Romanus said...

Thank you!!!

12/04/2007 12:21 PM  
Anonymous Anonymous said...

People advised against improving core functionality??? They said most people don't care about cataloging????

People are insane.

12/04/2007 12:33 PM  
Blogger Unknown said...

Before I go off and start altering things...

...we now have a "multiple copies" field. Is a "number of volumes" field planned for the future, or should we just use multiple-copies for now?

12/04/2007 12:36 PM  
Anonymous Anonymous said...

I can help you test Hebrew- and Hungarian-language libraries. You *will* have a Hungarian library, right? Riiight? ;]

And yay for increased multiple authors support!

12/04/2007 12:59 PM  
Blogger Ed said...

Festschrift, musth . . . I'm really much more literate than I used to be.

12/04/2007 1:06 PM  
Blogger Casey Durfee said...

"Have you had a look at the Physical Description Fixed Field (007)? A sound recording on compact disc would be coded sd|f (where s=sound recording; d=disc; |=undefined; f=1.4 m. per sec.)."

The problem there is that you only know the item is a CD instead of a phonograph based upon the size or playing speed of the item. You can't directly say "this is a CD".

12/04/2007 1:19 PM  
Blogger Torin/Darren/Who Ever... said...

Someone said you should focus on the social aspects instead of the core? That seems very foolish since there are much better social websites out there. Where LT shines is as a book cataloging site that happens to have social features, not as a social site with some book features.

Thank you for your focus and your work.

12/04/2007 1:46 PM  
Blogger Jason Riedy said...

So.. Is author disambiguation coming?

12/04/2007 2:00 PM  
Blogger Tim said...

Author disambiguation: Yes. The new "authors and roles" system treats authors differently—a whole different series of "primary keys" are involved. This was designed to allow us to move to disambiguation, which the previous system just wouldn't let us do. We've got a full plate, for sure, but we're made another step and, I expect, we'll see some more progress in the coming month.

12/04/2007 3:02 PM  
Anonymous Anonymous said...

*starts counting down to people asking if their private comments can be made seeable to their friends, or people in such and such group*
Thank you for doing that though.

I'm having fun trying out the new edit interface, it's great to see the author problem starting to be sorted out.

12/04/2007 3:20 PM  
Anonymous Anonymous said...

This all looks great. I'm disappointed, though, that the "Original Publication Date" field is not being added.

12/04/2007 3:21 PM  
Anonymous Anonymous said...

Great changes.

I'll be more than happy to help test searching Chinese language libraries.

12/04/2007 3:44 PM  
Blogger Tim said...

On the "original publication date," do you mean a new field for users to enter, or the Common Knowledge field?

T

12/04/2007 4:56 PM  
Anonymous Anonymous said...

This is wonderful, but I'm afraid a typo has broken work-combining: several of us have encountered SQL errors.

12/04/2007 5:31 PM  
Blogger Unknown said...

Yes, private comments are a real need

Private comment:

I think that the book ______ is really________. The author______
and co-author______should___________.

Signed, ___________

P.S. :*)

12/04/2007 6:20 PM  
Anonymous Anonymous said...

Tim,

Gasp! I hadn't seen the "Original Publication Date" field in the Common Knowledge section. That's exactly what I was looking for!

Thank you!

Wouldn't it be great if a chart showing that field were added to our "fun statistics"? Oh, yes, it surely would be.

12/04/2007 11:06 PM  
Blogger Jason Riedy said...

Author disambiguation: Cool! Thanks!

12/05/2007 2:06 AM  
Anonymous Anonymous said...

Engel's book is so good, Tim owns it twice!

12/05/2007 5:41 AM  
Anonymous Anonymous said...

Unfortunately the author/role system is NOT available for manually added new books.

12/05/2007 11:22 AM  
Blogger philn said...

Wonderful additions in this last update, I can hardly wait for the size/weight feature. With 16 boxes of mass market paperbacks (soon to be 22), I'd be very interested in just what all this weights.

Now that I think about it these features should prove useful when I get to the trade paperbacks and hardcovers also.

Keep up the good work and I am really glad that I've found this site and become a life member.

12/05/2007 1:07 PM  
Anonymous Anonymous said...

Better detail & edit pages! Multiple authors & roles! New fields!

Huzzah! Hooray! FINALLY! This is one of the things I've most been wanting since I first joined! Thank you!

Aaaannd...I will now stop adding exclamation points after every sentence and say that I find it really hard to believe that most people didn't care about getting the data right, and that the social aspect of this site was paramount. Buhwhah? That just boggles my brain.

I find the social aspects fun and niftykeen, but my primary use of this site is cataloguing and it always kinda bugged that the improvements you just added took so long to get here & seemed to be always pushed back in favor of promotion/social parts of the site.

Now I can't wait till we can upgrade our already existing catalog, seeing as how all my books are in here now and I can't use any of these nifty features till you do... :-)

12/05/2007 1:08 PM  
Anonymous Anonymous said...

Guys, you prove that a perpetually Beta site also a perpetually Bettah site!

12/05/2007 1:42 PM  
Anonymous Anonymous said...

rachael....

The obvious short term solution to your final comment: go out and buy a book. Right now!

12/05/2007 5:35 PM  
Anonymous Anonymous said...

Gemmation commanded me: Go out and buy a book. Right now!

Yes sir/ma'am! I will do that right away! Why didn't I think of that before?!? ::scurries off in search of a bookshop::

12/05/2007 6:48 PM  
Anonymous Anonymous said...

Now if we can just get Tim to write "like me" instead of "like I."
.
;-)

12/06/2007 1:40 AM  
Blogger James said...

Thanks much for these improvements! I do care deeply about getting the book stuff right. The ability to accurately and completely catalog my books is very important to my decision to continue using LT. I had actually been considering switching to a desktop cataloging product, but with these latest improvements, I've decided to stick with LT (and upgrade my paid account to a lifetime account).

The social stuff is great, too -- I'd really like to see the tag mirror come back, for example. I've gotten a kick out of browsing the libraries of others who share books with me, and exploring some of the other fun social features. But without the book data being right and useful, all that social stuff would be icing on a non-existent cake.

12/06/2007 3:08 AM  
Anonymous Anonymous said...

Thank you for working on the cataloguing.

We're greatly looking forward to improved serials support!

12/06/2007 4:00 AM  
Blogger Brett said...

Hey Tim and Co...

Question: What happened to the ability to do half stars for ratings? I wanted to do a two and a half star rating on a book, but I can only do full stars.

I use IE and double clicking the star to get a half doesn't seem to work for me. I miss the drop down. :<

LT user Gilroy

12/06/2007 3:24 PM  
Anonymous Anonymous said...

"weren't wasn't"...did you notice that little typo in the screen shot for private comments? :)

Also, I just added about 6 new items (granted they are DVD titles, but LT doesn't know that) and I do not have this new author function for them....

I'm sure it doesn't include creator, co-creator, producer, co-director, or director anyway.

12/06/2007 9:15 PM  
Blogger Young Geoffrion said...

Great new features!
I too will be happy to help test Chinese and Japanese libraries - at least half of my books are in Asian languages and have never been catalogued.
One more vote for getting the book information correct. Social aspects are icing on the cake - we ARE book readers, you know, holed up in our nests of paper like mice.

12/09/2007 2:14 PM  
Anonymous Anonymous said...

looks very pretty over here, though my loophole for adding more books than I'm allowed seems to have been fixed. i knew it was too good to be true... i suppose I'll have to scrap together enough money for a membership now.

In the mean time, I'll have to think about taking advantage of these improvements for the books I've already added.

12/10/2007 4:35 PM  
Anonymous Anonymous said...

Translators in particular will finally get their due.

Thanks SO much for that! We're overlooked enough as it is... it's so comforting to just get noticed/recognized. ;)

Not that I'm a literary translator or anything... (not that it isn't my dream job! :P)

12/10/2007 7:39 PM  

Post a Comment

<< Home