A rich tagging system for fantasy stories

Katharine Tree

Þæt wæs god cyning
Super Member
Registered
Joined
Jan 3, 2015
Messages
1,768
Reaction score
371
Location
Salish Sea
Website
katharinetree.com
Hi everyone--hope this is the right forum for this. If not, mods, please move it.

One of my Twitter buddies is trying to create a system for semantically-rich tagging of fantasy novels, so readers can sort them at a level much deeper than genre. She wants to include information about things like sorts of characters, themes, hot-button aspects (like rape scenes), and world type.

This is happening at its very earliest stages--information gathering, basically. She has set up a form for people to enter information about fantasy novels into her database. This is for proof-of-concept and to demonstrate user interest in the idea, so she can hopefully get some funding and developers interested in making it happen.

Here is her blog entry about it.

This seems like a fantastic idea, to me. It would really help indie and small-press authors be discovered, which is a great thing for everyone. So: read/write fantasy? Go on over there and enter some fantasy books.
 

Moriar

Registered
Joined
Dec 5, 2013
Messages
42
Reaction score
5
Location
Italy
This is really interesting, thank you for posting it.
As soon as I have some spare time this week I'll take the survey; it's a really good idea!
 

Roxxsmom

Beastly Fido
Kind Benefactor
Super Member
Registered
Joined
Oct 24, 2011
Messages
23,130
Reaction score
10,902
Location
Where faults collide
Website
doggedlywriting.blogspot.com
Discoverability is a big thing. I'm often frustrated by how inexact the "if you liked this book, then..." system is for Amazon etc (maybe because it keeps telling me I should read Robert Jordan's work, which I don't care for). Could be useful for finding comparable titles for our own novels too.

I went in and entered a book by a writer I enjoy to play with the system. I assume they either average all the categories (if they get more than one entry for a given book) or do they keep all of them?

Some things that are missing are more detailed settings. The book I entered had a sort of secondary world renaissance setting, so none of the categories fit (I entered "Renaissance like setting" by hand), and also there wasn't category related to cultural milieu or about character diversity, aside from LGBT characters. I wrote that in too, because one thing I look for are novels with more than a token female or PoC character and ones set in worlds where women can have adventures without having to dress up as boys. But some people prefer more traditional world building too, so I think that's a huge factor in whether a given novel will appeal to some readers.

Whenever something is done by popular vote, of course, it can get goofy, especially for novels with relatively few entries. I had to laugh at some of the books tagged in certain categories on goodreads lists for instance. Mercedes Lackey Grimdark? I mean, yes, her characters die a lot, but seriously?
 
Last edited:
Joined
Jun 29, 2008
Messages
11,042
Reaction score
841
Location
Second star on the right and on 'til morning.
Website
atsiko.wordpress.com
I built a proto-type web application like this for fun one time because I really like the concept.

I also left a pretty long comment on the post which I won't replicate here.

I think she has a good basic concept down, although versions have been done before. She probably needs to expand on her current filters to get a really good search/recommend application.


I'm also curious why she wants a purely curated tagging system. Perhaps instead the application could auto-provide the top 20 tags, or let you search to see if a tag exists, and provide some basic formatting to ensure that two tags aren't listed separately due to a stray hyphen or spelling difference?

Especially the "What's it about?"/"What should a reader know?" categories are going to be hard to make worthwhile using a purely curated system and her current options are quite restricting.

Maybe she could let the system propose to canonize user-generated tags when they reach a certain threshold, and then have them listed as an option instead of requiring the user to fill in "Other:________"?


She also has some incredibly subjective tags, which might need to be rephrased, altered, or contextualized by the algorithms involved to make them more meaningful to a given reader.


It's interesting that she was a software project manager, but there seem to be some serious holes even in her basic demo version.
 
Last edited:

veinglory

volitare nequeo
Self-Ban
Registered
Joined
Feb 12, 2005
Messages
28,750
Reaction score
2,934
Location
right here
Website
www.veinglory.com
I do feel like I have seen this tried before several times. So studying what happened with those initiatives might be informative. I would suggest focusing on tropes that certain people "auto-buy" rather than generic ways these books could be described but that are not strongly tied to purchasing choices. e.g. people auto-buy specific tropes like mpreg or centaur hero more than general common types like elemental magic or "chosen one" hero.
 

Katharine Tree

Þæt wæs god cyning
Super Member
Registered
Joined
Jan 3, 2015
Messages
1,768
Reaction score
371
Location
Salish Sea
Website
katharinetree.com
Certainly systems like this have been done many times before, and failed. While this is a very, very tiny data-gathering page she has put up, I agree that the limitations are frustrating. I suspect that if anything like this will be ultimately successful, the tags need to be crowdsourced. That eliminates Liosse de Velishaf's concerns about the subjectivity of tag meanings. Language is inherently subjective--as is the interpretation of fiction--but if the crowd has come to a consensus about what something means, then that's what it means.

Or it might all disintegrate like porridge in dishwater.

Anyway, this project is up my alley, and I thought I'd boost her signal. Will do the same for any similar projects I come across, because something like this needs to happen, and sooner or later someone will get it right.
 

Once!

Still confused by shoelaces
Super Member
Registered
Joined
Apr 22, 2012
Messages
2,965
Reaction score
433
Location
Godalming, England
Website
www.will-once.com
Interesting idea. I've left a comment. The problem with ideas like this is that they need to get a certain amount of critical mass before they take off. And it would be very easy for Goodreads or Amazon to do their own version if it looked like being a success.

And then there's the problem of spamming. How would you stop authors from flooding the system with sock-puppetry?

A good idea, but not easy to implement. Not easy at all.
 

Weirdmage

Super Member
Registered
Joined
Aug 19, 2011
Messages
562
Reaction score
52
Location
South Yorkshire, UK
Well, a big problem, and one that is already pretty significant on Amazon and Goodreas is that when you let people tag things themselves the tags become meaningless. There's been some discussions before about genre that show this. People will make up new labels, that may or may not be a different label for something that already exists, and people will misapply labels because they either do not know what they mean, or disagree with how they are used for whatever reason.

The idea itself is a good one, but I have a hard time seeing how it willultimately become a useful tool for readers looking for books.
 

robjvargas

Rob J. Vargas
Banned
Joined
Dec 9, 2011
Messages
6,543
Reaction score
511
And what's to stop someone like Amazon or Goodreads from employing tags to limit access to certain works?
 
Joined
Jun 29, 2008
Messages
11,042
Reaction score
841
Location
Second star on the right and on 'til morning.
Website
atsiko.wordpress.com
I do feel like I have seen this tried before several times. So studying what happened with those initiatives might be informative. I would suggest focusing on tropes that certain people "auto-buy" rather than generic ways these books could be described but that are not strongly tied to purchasing choices. e.g. people auto-buy specific tropes like mpreg or centaur hero more than general common types like elemental magic or "chosen one" hero.

I wonder if maybe that could just be a filter that could be applied? I feel like review sites/e-commerce sites already do an okay job of making those kind of connections. it seemed to me this wasn't necessarily intended to be part of an e-commerce site selling books so much as its own thing, an independent resource.

Certainly systems like this have been done many times before, and failed. While this is a very, very tiny data-gathering page she has put up, I agree that the limitations are frustrating. I suspect that if anything like this will be ultimately successful, the tags need to be crowdsourced. That eliminates Liosse de Velishaf's concerns about the subjectivity of tag meanings. Language is inherently subjective--as is the interpretation of fiction--but if the crowd has come to a consensus about what something means, then that's what it means.

I think I mentioned on the page that I thought at least some sort of crowd-sourcing feature would be necessary. I posited the definitions because she seemed set on curated tags, and she said in response to my comment that she had considered tooltips/parenthetical elaborations.

I do agree that crowd consensus has the potential to be more effective than curated tags.

Or it might all disintegrate like porridge in dishwater.

Anyway, this project is up my alley, and I thought I'd boost her signal. Will do the same for any similar projects I come across, because something like this needs to happen, and sooner or later someone will get it right.

Given my own experience proposing a similar idea a couple years ago, I suspect there is a good chance it will become porridge in dishwater. I'd think that there'd need to be a jack-of-all-trades involved in such a possibly niche idea in order to maintain steady progress--someone who could be the developer, the planner, and maybe even do a basic database of a few-thousand titles manually to get it up and running and ready for testing.

I think TVTropes does a good job of categorizing by tropes, although it lacks the rec function built on top of such a database.

I might look into re-opening my old version of this depending on how successful or not she is. I can do the development myself--unlike her, I believe--but she has a major advantage in terms of visibility, since my online presence has been fairly weak of late. And I'm doing other projects currently. But I'd definitely like to see some strong attempts at something like this.

Interesting idea. I've left a comment. The problem with ideas like this is that they need to get a certain amount of critical mass before they take off. And it would be very easy for Goodreads or Amazon to do their own version if it looked like being a success.

That's a major danger to any individual developer, and there's the added problem that because of their user/customer base, Amazon/Goodreads could make a much-reduced/crappier version and come out ahead anyway.

And then there's the problem of spamming. How would you stop authors from flooding the system with sock-puppetry?

A good idea, but not easy to implement. Not easy at all.

That's a major issue. It might require either a user account system, which would have a lot of other benefits anyway, or perhaps a delayed-addition feature, such that there'd be a way to do some sort of moderation and delete spam before it affects the rankings.

Well, a big problem, and one that is already pretty significant on Amazon and Goodreads is that when you let people tag things themselves the tags become meaningless. There's been some discussions before about genre that show this. People will make up new labels, that may or may not be a different label for something that already exists, and people will misapply labels because they either do not know what they mean, or disagree with how they are used for whatever reason.

I think you could include in the ranking algorithms a way to ignore outliers like that. You could also maybe have tags that the database hasn't seen before be looked over by someone before they're permanently entered into the system. But it's still a major hassle that would have to be dealt with.

The idea itself is a good one, but I have a hard time seeing how it will ultimately become a useful tool for readers looking for books.

I think it could become useful, but I agree there's a lot of stuff that needs to be worked out.

And what's to stop someone like Amazon or Goodreads from employing tags to limit access to certain works?


I think this particular system is not intended to be part of a major online book retailer, but that's also an issue that would have to be looked out for.
 

AlexisRadcliff

Writes About Writing
Registered
Joined
May 6, 2015
Messages
30
Reaction score
1
Location
Washington
Website
www.lexirad.com
Great discussion here. Thanks, everyone! I just wanted to say hello, and that I'm lurking, and that I really appreciate the feedback.

Rest assured that my partner and I are thinking hard about everything being discussed in this thread as we iterate towards what we hope will be a really cool solution for fantasy book discovery. :)
 

Twick

Super Member
Registered
Joined
Oct 16, 2014
Messages
3,291
Reaction score
715
Location
Canada
And what's to stop someone like Amazon or Goodreads from employing tags to limit access to certain works?

Self-interest? In that they actually want to sell the books they stock?

If you mean that Amazon might not stock books carrying certain themes that are highly objectionable or even illegal, do you really think that doesn't happen now?

Now, I suppose someone could sabotage someone else's book by sticking tags of that nature on it. That's more of a concern.
 

ebrillblaiddes

Super Member
Registered
Joined
Dec 15, 2006
Messages
148
Reaction score
14
Doesn't Amazon already have a tagging system, it's just underutilized because no one knows what it's for or something like that?
 

Weirdmage

Super Member
Registered
Joined
Aug 19, 2011
Messages
562
Reaction score
52
Location
South Yorkshire, UK
They have "keywords", but I've never seen explicit semantic tags when using the site.

That's just semantics. What Amazon uses is usually called tags by the people I know. -As in "tagged as: Left-handed, Bisexual, 3/4 Venusian, Historical, Urban, Fantasy", which usually is a "genre" that you can use to claim you are a "Best Seller"...
Anything that is crowd-sourced will get gamed in this day and age.
I already have given up on finding books on Amazon by subgenre, the self-decleration makes it hopeless.
 

AlexisRadcliff

Writes About Writing
Registered
Joined
May 6, 2015
Messages
30
Reaction score
1
Location
Washington
Website
www.lexirad.com
Anything that is crowd-sourced will get gamed in this day and age.

That's one of the big challenges with designing a system like this, and there are definitely ways to fight it, but it's going to take some experimentation and tweaking to find the right solution that leaves things open enough to be useful and closed enough to prevent abuse.
 
Joined
Jun 29, 2008
Messages
11,042
Reaction score
841
Location
Second star on the right and on 'til morning.
Website
atsiko.wordpress.com
That's just semantics. What Amazon uses is usually called tags by the people I know. -As in "tagged as: Left-handed, Bisexual, 3/4 Venusian, Historical, Urban, Fantasy", which usually is a "genre" that you can use to claim you are a "Best Seller"...
Anything that is crowd-sourced will get gamed in this day and age.
I already have given up on finding books on Amazon by subgenre, the self-decleration makes it hopeless.


Is that something the author does?


They have always appeared to me to be based on titles and maybe the descriptions. I can't seem to look at what a given book's been tagged with on its page, or in any systematic way.

For example, I did a search for "chosen one" and the books that came up had one of those words in the title or series name, but I couldn't find any suggestion that books featuring the trope were so tagged.


Library thing does in fact have such a system, I believe. It'd definitely be useful for the person doing this project to check them out and see what might be missing or what mistakes they might have made.

Certainly I had no trouble with a few quick searches finding some highly-ranked but inaccurately tagged books.
 
Last edited:

krjwrites

Registered
Joined
Mar 16, 2015
Messages
32
Reaction score
5
Location
Los Angeles, CA
Just wanted to pop in and say that this sounds cool! I've not heard of the other (failed) projects that attempted to do this, but I fully support the idea. I'm looking for books to read (and books to use as comps) and posting in a forum like this every time gets a little old. If I could use a system that gave me first person, female protagonist, hero's journey with a traveling component stories, that would be great. Neither Amazon or Goodreads has helped me narrow down anything to that level.
 

SBibb

Super Member
Registered
Joined
Feb 2, 2011
Messages
1,573
Reaction score
116
Website
sbibb.wordpress.com
This is an interesting idea. I submitted info on a book I'd recently read and retweeted the blog post. Thanks for bringing this up. :)
 

kuwisdelu

Revolutionize the World
Super Member
Registered
Joined
Sep 18, 2007
Messages
38,197
Reaction score
4,544
Location
The End of the World
Anything that is crowd-sourced will get gamed in this day and age.

Yes, it will. It will also still be better than anything curated unless whoever's doing the curating has MASSIVE capital and humanpower.

Also, porn continues to be ahead of the curve here.
 
Last edited: