Closing Delicious? Lessons to be Learned

There was a kerfuffle a couple weeks back around Delicious when the social bookmarking service Delicious was marked for end of life by Yahoo, which caused a rather large number I know to go rather nuts. Yahoo, has made the claim that they are not shutting the service down, which only seems like a stall tactic, but perhaps they may actually sell it (many accounts from former Yahoo and Delicious teams have pointed out the difficulties in that, as it was ported to Yahoo’s own services and with their own peculiarities).

Redundancy

Never the less, this brings-up an important point: Redundancy. One lesson I learned many years ago related to the web (heck, related to any thing digital) is it will fail at some point. Cloud based services are not immune and the network connection to those services is often even more problematic. But, one of the tenants of the Personal InfoCloud is it is where you keep your information across trusted services and devices so you have continual and easy access to that information. Part of ensuring that continual access is ensuring redundancy and backing up. Optimally the redundancy or back-up is a usable service that permits ease of continuing use if one resource is not reachable (those sunny days where there's not a cloud to be seen). Performing regular back-ups of your blog posts and other places you post information is valuable. Another option is a central aggregation point (these are long dreamt of and yet to be really implemented well, this is a long brewing interest with many potential resources and conversations).

With regard to Delicious I’ve used redundant services and manually or automatically fed them. I was doing this with Ma.gnol.ia as it was (in part) my redundant social bookmarking service, but I also really liked a lot of its features and functionality (there were great social interaction design elements that were deployed there that were quite brilliant and made the service a real gem). I also used Diigo for a short while, but too many things there drove me crazy and continually broke. A few months back I started using Pinboard, as the private reincarnation of Ma.gnol.ia shut down. I have also used ZooTool, which has more of a visual design community (the community that self-aggregates to a service is an important characteristic to take into account after the viability of the service).

Pinboard has been a real gem as it uses the commonly implemented Delicious API (version 1) as its core API, which means most tools and services built on top of Delicious can be relatively easily ported over with just a change to the URL for source. This was similar for Ma.gnol.ia and other services. But, Pinboard also will continually pull in Delicious postings, so works very well for redundancy sake.

There are some things I quite like about Pinboard (some things I don’t and will get to them) such as the easy integration from Instapaper (anything you star in Instapaper gets sucked into your Pinboard). Pinboard has a rather good mobile web interface (something I loved about Ma.gnol.ia too). Pinboard was started by co-founders of Delicious and so has solid depth of understanding. Pinboard is also a pay service (based on an incremental one time fee and full archive of pages bookmarked (saves a copy of pages), which is great for its longevity as it has some sort of business model (I don’t have faith in the “underpants - something - profit” model) and it works brilliantly for keeping out spammer (another pain point for me with Diigo).

My biggest nit with Pinboard is the space delimited tag terms, which means multi-word tag terms (San Francisco, recent discovery, etc.) are not possible (use of non-alphabetic word delimiters (like underscores, hyphens, and dots) are a really problematic for clarity, easy aggregation with out scripting to disambiguate and assemble relevant related terms, and lack of mainstream user understanding). The lack of easily seeing who is following my shared items, so to find others to potentially follow is something from Delicious I miss.

For now I am still feeding Delicious as my primary source, which is naturally pulled into Pinboard with no extra effort (as it should be with many things), but I'm already looking for a redundancy for Pinboard given the questionable state of Delicious.

The Value of Delicious

Another thing that surfaced with the Delicious end of life (non-official) announcement from Yahoo was the incredible value it has across the web. Not only do people use it and deeply rely on it for storing, contextualizing links/bookmarks with tags and annotations, refinding their own aggregation, and sharing this out easily for others, but use Delicious in a wide variety of different ways. People use Delicious to surface relevant information of interest related to their affinities or work needs, as it is easy to get a feed for not only a person, a tag, but also a person and tag pairing. The immediate responses that sounded serious alarm with news of Delicious demise were those that had built valuable services on top of Delicious. There were many stories about well known publications and services not only programmatically aggregating potentially relevant and tangential information for research in ad hoc and relatively real time, but also sharing out of links for others. Some use Delicious to easily build “related information” resources for their web publications and offerings. One example is emoted by Marshall Kirkpatrick of ReadWriteWeb wonderfully describing their reliance on Delicious

It was clear very quickly that Yahoo is sitting on a real backbone of many things on the web, not the toy product some in Yahoo management seemed to think it was. The value of Delicious to Yahoo seemingly diminished greatly after they themselves were no longer in the search marketplace. Silently confirmed hunches that Delicious was used as fodder to greatly influence search algorithms for highly potential synonyms and related web content that is stored by explicit interest (a much higher value than inferred interest) made Delicious a quite valued property while it ran its own search property.

For ease of finding me (should you wish) on Pinboard I am http://pinboard.in/u:vanderwal

----

Good relevant posts from others:

• Why You Should have a Website - Jeremy Keith
• We can save Delicious, but probably not in the way you think
• Delicious in Purgatory :: TechCrunch

Bing Likes Like, But Does it Mean We Do

Last week Microsoft Bing and Facebook announced Facebook is now part of Bing search. The part that has been touted the most is Bing's inclusion of Facebook Likes.

For me this is really surprising as Like has very little value, what little value is has is confounded by it lacks any explicit understanding of intent. Search is about finding what is being sought, which is much harder than it sounds, particularly with massive amounts of information, or when searching across contexts and influences. Like really doesn't add much of anything of value to this. Why somebody likes something is really important to understand, or more importantly even if a person actually likes what they placed a like on, or if they were using it as a proxy for a bookmark to hold on to something so to return later, or even if the Like is a social statement.

One of my trips to California I was with friends and we were trying to sort out where to grab something to eat. One friend suggested In-N-Out, she figured it was well liked and even the guy who is vegetarian would be in on it as he liked it on Facebook (she remembered). The vegetarian in the group strongly preferred not to go there and wanted an option with better vegetarian offerings. When he was asked why he put a Facebook Like on it he said, "I like hanging out with my friends there as it makes them happy, but I usually have eaten before, or will after. Now I am hungry and wish to eat, so I really prefer something other than In-N-Out." This triggered everybody talking about their doing similar things with Like in Facebook, which really didn't mean they liked what they clicked "Like" on.

Facebook Like, much like the often problematic star ratings, adds more ambiguity (or another value point that has no clear meaning that can be reliably used for search or predictors). My favorite recommendations from Facebook are those similar to "Those who like food also like sleep.", which gives me the option to like sleep. (We can cure cancer if we keep this intelligent thinking up.)

What is Next? The Past!

So, if this augmented ambiguity from using Facebook Like in search is problematic leads you to think, "What is better?" Well, a look back to 2005 or 2006 at Yahoo! is a very good place to start. Somewhere in this timeframe Yahoo Search did something smart, no freakishly smart (actually connecting two things together that made a giant difference for search). Yahoo! had its own social bookmarking service "My Web", which was somewhat similar to Delicious (which Yahoo acquired). The second version of MyWeb (MyWeb2) made it easy to see one's own bookmarks that you yourself tagged in your own context, your friends bookmarks they had tagged with their tag terms in their context, and everybody's. Yahoo! incorporated the tags and social connections from MyWeb2 into their search. This dramatically improved the search, if you were using MyWeb2 and particularly if you had stated people you were connected to.

At this point Yahoo! not only caught up to Google but passed it by a large margin for me. Why? Google was very good at finding good results, often good enough. Yahoo! with MyWeb2 built in and using my 60 to 70 people I was connected to started surfacing exactly what I was looking for. This was happening regularly. This was search Nirvana. Let's step back slightly to understand why.

Proper Social Understandings Improve Search Precision

One of the interesting things about people tagging content to store it in services like MyWeb2 or Delicious (or any other folksonomy tagging service) is people almost alway only tag things they have interest in. Based on the assumption (which holds up well) that people hold on to thing they like, but when they drift from that they usually will add tags that state that deference.

Search is difficult because of contextual influences and ambiguity. Having tagging done by people whom you know can help with that contextualization. People whom you know having tagged things around what you are seeking and use the terms in similar manner to the way you do has value. Well, no not really, it has insanely great value. The key is sorting out similar affinities (as close as possible) and similar term use helps to further remove ambiguity, which becomes clearer when you can parse things through the lens of a granular social network. With just 60 to 70 people my world of search was turned upside down in a very positive way. All search results that had been bookmarked and tagged by people I was connected to were annotated with their their name and often tags.

This giant step forward for Yahoo! did not last long as after a few months the experiment was over and Yahoo search returned to being not as helpful as Google search, which is just good enough.

The Yahoo experiment was not perfect, but it was much closer than most anything else to that point. Holding it back was the lack of people you were connected to. The more people you were connected to, to some degree, was helpful. Also, very few people knew about this experiment (it didn't seem like an experiment at the time, as it seemed it could only grow, but Yahoo really didn't seem to know how to get the word out or talk about this value, it was an information geek thing (yes, I could fall into that grouping). But, the piece missing that would have been most helpful, was the ability to garden and craft your relationships to those with whom you connected.

The gardening and contextualizing those with whom you are connected is really powerful. It doesn't need to be publicly exposed but the tools and service can make giant leaps forward if we have this. Most of this contextualization is assumed by tools and services, but having explicit crafting takes the guessing out. Being able to add fuzzy (roughly defined) semantic terms to attract what you value from that person closer while keeping the things of less of value at bey, can be helpful. This is core to the model of attraction (draft) idea that has been my frame for much around me for years. Being able to tag or annotate "Jim" with cycling, food, social search, design, and baseball will help search bring things roughly related to those topics or terms close to me, but may not give as high of relevance for his passion for early 1990s dot matrix printers nor Hobbits.

Next Step?

The next step for this as in terms of products and services also has happened. An enterprise social bookmarking service, Connectbeam (now gone) took the next step (Lotus Dogear, now Lotus Bookmarks in their Connections tools is somewhat similar) by bringing this same social tagging into the work environment and then surfacing that added value into search results. What set Connectbeam apart from others doing similar efforts was it helped people understand the social components better than most. They had some really good social interaction designs around the connecting people, that really started to get at some of the tough nuances that are really hard to crack outside the early adopter types using service (only 5 to 15% of most orgs will fall into that early adopter mindset, the rest are really lost with this). This crafting and understanding social interactions allowed Connectbeam to have the potential to drastically improve search, (search is a very expensive and painful proposition at every organization I have run across). The social interactions needed for comfort, familiarity, and producing value is central to getting any service right, but the hurdle is big but there is a large positive value if you get that right for social tagging. Sadly, Scuttle and thin not well thought through attempts at social tagging really do not add to much either.

Spending time to understand the keys to getting it right and selecting tools that do it well or working with vendors to get there will pay off.

On Fire with Social Progressions

When talking with organizations about social tools and logical social flows for information from ideas all the way to formal outcomes (white papers, process docs, product enhancement requirement documents, etc.) there have always been stated steps. Some of these steps have different incarnations and labels, depending on how things are done conventionally. But, there is a usual natural progression of how these flow that is rather common and universal across organization types (formal or not).

To these progression points there are classes/types of tools or services that map well to these, but very rarely is it one tool/service set crosses these, but whether it is all tools/services under one umbrella application or distinctly different instances, they really should be linked and integrated as seamlessly as possible.

The steps in the social progression are as follow:

Personal

The first step or home base, is more of a state for beginning, is the the personal space and repository. Sadly, this is the ugly step child that is very often missed in many tools/service offerings. The place were a person has a view of their resources, which is mapped in their context and needed representations to make sense with the least effort. This is the view with things they need to see surface (from their perspective and from others) and from where they jump to interacting with information, objects, tasks, and others.

Sparks (Ideas Shared)

The first step often comes from asking questions simply and easily and quick easy responses, or sharing quick notes and ideas that get feedback and interest. Many times this is done efficiently in micro sharing services like similar to Twitter but with a grasp of needs organizations have (Socialtext Signals or Socialcast are solid options to consider). But, other options, including blogs and discussion forums have the capability of doing this as well.

With sparks of ideas they need to have the ability to be found so to be responded to, aggregated, or even shared to ensure the right people see them and can interact. There is a wide breadth of types of things that flow through micro sharing services, but many will resonate, inform, or inspire others. But, quite often they get solid conversations flowing across a broad cross section of people and locations.

Campfire (Gathering of Others with Interest)

From the spark of inspiration many others with interest or affinity gather to discuss and the spark turns into a campfire. Stories are told and fuel is added to the fire. Honing of the ideas and gather inspiration, information, and content from broad sources and view is then curated and honed to some degree.

The tools needed for the campfire stage must allow from much broader conversation than the limited spark stage. Limiting the room around the campfire to those with strong interest and affinity helps keep the focus, but also these people will likely have the deepest reserves of fodder for the conversation and a wide variety of perspectives and resources they can tap ready at hand. Longer conversation and curating all that is gathers are the prime focus. Curation through tagging is often incredibly helpful (being able to tag so to aggregate and curate ideas from the sparks stage is highly important).

Bonfire (Broader Interest Gathering)

Once the ideas have been fleshed out and framed to some degree and curated to control scope the discussion turns into a bonfire. Bonfires, while much larger still need to be controlled and maintained or they get out of control and things get dangerous. At this stage broad viewing for healthy feedback and discussion, including highlighting things that have been missed, what works well, what doesn't work well, etc. are the key focus. This is the time to get understanding and direction that hones and shapes everything that is possible. It is also used to add to what has been gathered and curated in the campfire stage so to iterate on it.

Torch (Honing for Broad Use & Replication)

Lastly, is the torch stage. This is easy to handle, easy to replicate, and is safe. This requires Real Collaboration to work through the conflicting ideas and negotiate as well as intelligently work toward one final output. These final outputs can be white papers, new processes, new guidelines, new products, etc. But, the point is there is one (just like artists collaborating on a statue there is only one statue, not many and all through differences have been worked through to one salient solution).

Understanding the Cost of We Can't Find Anything

One problem I often hear when talking with any organization about new solutions is understanding the cost and inefficiency of their existing way solutions, processes, or general way of doing things. In the past year or two I have used various general measurements around search to help focus the need for improvement not only on search, but the needed information and metadata needed to improve search.

We Can't Find Anything

There is nothing more common that I hear from an organization about their intranet and internal information services than, "We can't find anything." (Some days I swear this is the mantra that must be intoned for an organization to become real.)

There are many reasons and potential solutions for improving the situation. Some of these involve improved search technologies, some improved search interfaces, or But, understanding the cost of this inefficiency is where I find it is valuable to start.

The first step after understanding you have this problem is to measure it, but most organizations don't want to pay for that they are just looking for solutions (we all know how this turns out). The best method I find is walking through the broad understandings of the cost of inefficiencies.

The Numbers...

At Interop 2009 I presented "Next Generation Search: Social Bookmarking and Tagging". This presentation started off with a look at the rough numbers behind the cost of search in the enterprise (see the first 16 slides). [I presented a similar presentation at the SharePoint Saturday DC event this past week, but evaluated SharePoint 2010's new social tagging as the analysis focus.]

Next Generation Search: Social Bookmarking and Tagging

View more presentations from Thomas Vander Wal.

Most of the numbers come from Google white papers on search, which gets some of their numbers from an IDC white paper. I also have a white paper that was never published and is not public that has slightly more optimistic numbers, based on the percentage of time knowledge workers search (16% rather than the Google stated ~25% of a knowledge workers time is spent searching). There are a few Google white papers, but the Return on Information: adding to your ROI with Google Enterprise Search from 2009 is good (I do not endorse the Google Search Appliance, but am just using the numbers used to state the problem).

I focus on being optimistic and have I yet to run into an organization that claims to live up to the optimistic numbers or total cost of inefficiency.

• Few organization claim they have 80 percent of or better success with employees finding what they need through search
• That is 80 percent success rate
• Or, 1 in 5 searches do not find what is they were seeking
• A sample organization with 500 searches per day has 100 failures
• An average knowledge worker spends 16% of their time searching
• 16% of a 40 hour work week is 1.25 hours spent searching
• 20% (spent with unsuccessful searches) of 1.25 hours a week is 15 minutes of inefficient productivity
• At an average salary of $60,000 per year that leads to $375 per person of inefficient productivity
• Now take that $375 per knowledge worker and multiply it by how many knowledge workers you have in an organization and the costs mount quickly
• An organization with 4,500 knowledge workers is looking at a inefficiency cost of $1,687,500 per year.
• Now keep in mind your knowledge workers are you most efficient at search
• Many organizations as a whole are running at 40% to 70% success rate for search

We Know We Have a Costly Problem

This usually is enough to illustrate there is a problem and gap with spending time resolving. The first step is to set a baseline inside your organization. Examine search patterns, look at existing taxonomies (you have them and use them to some degree, yes?) and work to identify gaps, look at solutions like tagging (folksonomy) to validate the taxonomy and identify gaps (which also gives you the terms that will likely close that gap). But get a good understanding of what you have before you take steps. Also understand the easy solutions are never easy without solid understanding.

Evaluating what, if any taxonomy you have is essential. Understand who is driving the taxonomy development and up keep. Look at how to get what people in the organization are seeking in the words (terms) they use intend to find things (this is often far broader than any taxonomy provides).

Enterprise 2.0 Wrap-up

Each year the Enterprise 2.0 Conference has been different for me, this was my third year in a row attending. Two years ago there were a organizations trying these tools (other than on a server under somebody’s desk), tool makers were trying to catch-up to potential customer desires, and most consultants were trying to apply old models of thinking to Enterprise 2.0 (which broke most of their models). Last year the tools started to catch-up with offerings that were much closer to customer desires, a much broader set of businesses were interested and looking for understanding, and the big consulting firms were touting their successes with out understanding what they did.

This year at Enterprise 2.0 had a very different feel. There is getting to be good depth of understanding of the potential capabilities from customers. The tool makers are really hitting stride and solving some of the tricky problems that come with a six months to a year of use inside an organization (see sub-head below "Open Source Tools as First Step") to understand what the tool makers are doing is valuable. Consultants are getting it, but the big consulting firms continue to have value in individuals and not the firms. The most impressive consultants (and analysts) are the solo players and small firms.

Twitter and Microsharing for Enterprise

There were a handful of very well attended sessions on Twitter and similar microsharing tools for the enterprise this year (last year only one). The sessions were largely love-fests of "isn’t this great" and "here is the value", which is good. But, there are some downsides that need addressing and sticking my head in a few sessions (too packed to get a seat) and talking with others who attended the sessions, the downsides (they have solutions, but not quite built yet) were not highlighted nor were the potential solutions.

I am skipping the positives of these tools as they are can be found quite readily. The cautions and lessons learned relate to two points the volume & velocity of information and use/reuse of the snippets.

Nearly every organization that has successful adoption with microsharing tools quickly believes there can be too much of a good thing. Like my presentation last year at Enterprise 2.0 (After Noah: Making sense of the flood (of information) microsharing has great content flowing through it, but it needs filters (on who and what) as well as as attractors for grabbing things that are valuable that pass through when the user is not looking (the "if it is valuable it will find you" is not something that you want your organization to depend upon).

The second issue is use and reuse of that information. The information snippets running through the microsharing tools are often valuable, some have future value and are received out of the context of need, while others have current value. Most of the tools only focus on sharing the snippets not holding on to them or easily turning them into other valuable information forms (documents, blogs, aggregation of related items for discussion, etc.). Without thinking of what comes next with information flows in the organization’s ecosystem problems get created quickly from the cool adoption. That is not to say that the solutions are difficult or around the corner, but they are not in most products yet.

One service that I saw in the exhibit hall that used the organization’s ecosystem well was Brainpark. Brainpark is a mix of microsharing, aggregation of information and objects, and builds off of experience across the organization. It is a hosted solution that is a fully open space and transparent across the organization (depending on your organization that is good or less than optimal (Sarbanes Oxley peeks in).

Case Studies Predominantly from Government and Government Contractors

This year, just like the past two a majority of the case studies were government or government contractors. Susan Scrupski asked in a Tweet why this was so. One reason (having worked inside government as a contractor doing this things nearly a decade ago) is freedom to talk about what is going on. Many businesses look at these tools as competitive advantage and will talk about the their success on a high level, but lessons learned (downsides) start running into SEC regulations and admissions of less than optimal results (a downside for stocks). Also many of the companies using the new breed of social tools are technology related companies and often they are considering how to turn what they have deployed into a product they can sell in the future or at least a service offering. This sharing can run a foul of SEC restrictions. The government organizations and government contracting companies are freer to discuss their implementation of these tools and the contracting companies see this as a means to pitch their capabilities.

Last year Lockheed Martin generated a lot of buzz with their discussion of the platform they assembled and built. This year they discussed it in more depth, but the point that the only two infringements on their service were one person selling their car (no commerce is allowed) and one person criticizing a decision by the CEO (nobody is allow to criticize the CEO) were good for demonstrating how well people use the social tools with little concern (although the buzz from LM’s presentation to a person this year was "I will never work for LM because you can’t criticize the CEO").

Booz Allen Hamilton was the Open Enterprise winner and discussed in-depth their tool deployment and their use of open source tools and low cost for deploying. This was quite a different perspective from Lockheed Martin’s deployment last year that was incredibly costly.

Open Source Tools as First Step

One thing that I have seen across the years, not only at Enterprise 2.0 but prior, is that many organizations start their social tool endeavors with open source tools. While I am a big proponent of open source tools, one has to be mindful of the disadvantages as well as the advantages (just like every other tool). Open source tools are a good first step to see how tools could be used in an organization, but many of the tools need extensive customization to scale and to meet the the user experience and social needs of those who are not an organization’s early adopters.

In my presentation last year "After Noah…" most of the downsides and lessons learned came from people deploying Scuttle as their social bookmarking tool. Scuttle is a decent tool for small deployments in-house that do not need to scale, but the management of the tools and the lack of intelligence in Scuttle that is needed to deliver solid knowledge and understanding around the organization are not in it. There are many elements in Scuttle that limit adoption, unless in a very tech savvy environment, and require moving to a real social bookmarking and tagging solution after six month or a year. Not only is adoption hindered, but easily surfacing information, knowledge, and intelligence captured in the tool is really difficult. Scuttle lacks the algorithms, social understanding, contextual engine, and user experience to be a long term (more than one year) solution for anything more than a small division.

The other open source tool that is widely deployed and equally as problematic as Scuttle is MediaWiki. I continually see MediaWiki deployed because it is “what is under Wikipedia”. While that is well and good to get started, MediaWiki falls into the same problems as Scuttle with adoption, scale, lack of the essentials, and missing intelligence engines. MediaWiki requires heavy modifications to work around these problems. One of the problems that is most problematic are those around human social interactions, which nearly every organization I talk with lacks in their resources as they development and design teams that build, implement, and incrementally improve their products.

Both of these tool types (social bookmarking and wikis) have great commercial products that provide much better overall adoption opportunities as well as have full-time staff who understand what is needed to get the most value out of what is contributed and how to include the difficult pieces around sociality, which greatly increase adoption and long term use.

More Than Just Tools

This year there was quite a bit of discussion at Enterprise 2.0 around tools are good, but there is much much more than just tools as as a solution. Adoption practices were discussed broadly, but some of the best snippets that echo my experience were in the video clips captured by and used by Stowe Boyd and Oliver Marks in their Open Enterprise session (the full collection of unedited video interviews are available at Enterprise 2.0 - Open Enterprise [http://enterprise2blog.com/category/open-enterprise-2009/]). One snippet that rang very true was from Charlene Li where she talked about a large hindrance to adoption was people lacking the understanding of what openness is in the enterprise and that it is a possibility. I often find most organizations need to have the conceptual model (understanding of what the tools are and freedom and control put in the people’s hands as well as it is their organization allowing them to do this) into people’s head is the first step and not talking "carrots and sticks", which often lead to less than optimal long term outcomes and often are counter productive.

It was great to hear other people discussing this in sessions as well as the hallway conversations. If this is of interest the full videos have been made available to the community to listen to and use as an open resource. Please go take advantage of it and use them to help get informed.

Gaps in Sociality

Much of my discussions with my clients and potential clients as well as my 13 years of experience building, maintaining, and improving social tools for use involves focusing on what holds back adoption and use of tools. There are four elements that need to be in balance: Tools, user experience (ease of use), sociality, and adoption/engagement resources. Much of that was discussed in sessions at Enterprise 2.0 this year was tools and adoption/engagement strategies (as just stated there were some large holes in adoption and engagement strategies). On the exhibit hall floor the vendors were touting their ease of use and user experience that is built into their products.

The big gap that was really weak was sociality. As those who have deployed tools and worked to improve them have found how people interact with other people in these digital social tools is a large area that needs addressing. This is one area that really needs to be addressed within the tools as the depth of understanding needed inside organizations to add this is rarely there. There is a large education effort needed to explain what all of this is, how to think about it, how to evaluate tools/solutions around it, how to assess existing deployments, and how to then improve them. When I have IT shops or developers in my workshops this is an area that is really not familiar to most of them. Some of the user experience designers have an understanding of the need, but lack the skills to get the back end development in place to feed the front end components. Most decision makers do not have this on their radar (unless they have had tools and services running for 6 months to a year and are looking for that next step up), but even when they do they only understand something there is broken and lack enough understanding to know how to understand the problems and then address it.

As I talked with people in the hallways and late at night and mentioned scenarios that are indicators of problems in tools around sociality, nearly everybody said yes we see a lot. To a person not one of them had thought of sociality as a problem or even knew of anybody who could help understand it and address it.

This is the next hurdle to start getting over. Hopefully next year and at this Fall’s Enterprise 2.0 in San Francisco, this will be subject matter that is covered so to highlight where the problems lay and how to start working with vendors and developers on ways to improve on what is there.

[If you are looking to get a grounding in this I am finally offering workshops on Social Design for Enterprise, which is described in more depth in the Rock Stars of Social CRM. The real stories, experience, value to organizations, tethering CRM and interaction in social tools not only was great from a showing the power of use of tools in a manner that had deep business value, but the stories of real use and lack of tools and services around optimized use of the tools. This session really should have been not only in the main tracks, but could have stood out enough to have been a main session. It added credibility and depth of understanding social tools from a business perspective in a manner that makes the usual social media discussions look incredibly thin. Radian6, Chris Brogan, Paul Greenberg, Brent Leary, Frank Eliason, and Michael Thomas (National President of the CRM Association) did a killer job with this session and totally rocked the house.

Tagging

Lastly, tagging. While there was not tagging focussed session and tagging has become the sleeping giant (nearly every social software consultant with deep background asked why there was not a session on tagging as they are finding it is one of the most valuable resources in their tool belt for driving value to their customers). Connectbeam and Lotus Connections Dogear were on the Exhibition floor and were getting attention, I heard nearly every other vendor touting they have tagging in their offerings. This is a good thing and something that is also problematic.

About four years ago I prognosticated tagging would be in most tools, but that reality was going to be problematic unless tagging was done well (at a minimum object being tagged, tag, and cross tool identity of the person tagging). Well this last year I had one large client hit that problem and since I have heard of it five or six more times. While some commercial tools have done tagging well most home grown or open source solutions (see the WikiMedia mention above) do not.

My presentation from last year is even more relevant this year and there is a dire need for aggregation and disambiguation across tagging in various tools. At the Enterprise 2.0 conference I heard this echoed many times when I started asking about tagging in deployments. There is much more to write on this and to share (yes the book is still coming and much of this will be addressed there as well as in future posts).

Summary

Enterprise 2.0 has become my favorite conference as the problems I have been seeing for years and working on resolutions are echoed here. The reality of Web 2.0 and social interaction hits home here, particularly the lack of depth and problems in the Web 2.0 tools (which also need to be addressed, but with millions of users it looks like success not a really small percentage of adoption).

I am looking forward to next year as well as the Enterprise 2.0 San Francisco conference in the Fall.

Social Design for the Enterprise Workshop in Washington, DC Area

I am finally bringing workshop to my home base, the Washington, DC area. I am putting on a my “Social Design for the Enterprise” half-day workshop on the afternoon of July 17th at Viget Labs (register from this prior link).

Yes, it is a Friday in the Summer in Washington, DC area. This is the filter to sort out who really wants to improve what they offer and how successful they want their products and solutions to be.

Past Attendees have Said...

“A few hours and a few hundred dollar saved us tens of thousands, if not well into six figures dollars of value through improving our understanding” (Global insurance company intranet director)

From an in-house workshop… “We are only an hour in, can we stop? We need to get many more people here to hear this as we have been on the wrong path as an organization” (National consumer service provider)

“Can you let us know when you give this again as we need our [big consulting firm] here, they need to hear that this is the path and focus we need” (Fortune 100 company senior manager for collaboration platforms)

“In the last 15 minutes what you walked us through helped us understand a problem we have had for 2 years and a provided manner to think about it in a way we can finally move forward and solve it” (CEO social tool product company)

Is the Workshop Only for Designers?

No, the workshop is aimed at a broad audience. The focus of the workshop gets beyond the tools’ features and functionality to provide understanding of the other elements that make a giant difference in adoption, use, and value derived by people using and the system owners.

The workshop is for user experience designers (information architects, interaction designers, social interaction designers, etc.), developers, product managers, buyers, implementers, and those with social tools running already running.

Not Only for Enterprise

This workshop with address problems for designing social tools for much better adoption in the enterprise (in-house use in business, government, & non-profit), but web facing social tools.

The Workshop will Address…

Designing for social comfort requires understanding how people interact in a non-mediated environment and what realities that we know from that understanding must we include in our design and development for use and adoption of our digital social tools if we want optimal adoption and use.

• Tools do not need to be constrained by accepting the 1-9-90 myth.
• Understanding the social build order and how to use that to identify gaps that need design solutions
• Social comfort as a key component
• Matrix of Perception to better understanding who the use types are and how deeply the use the tool so to build to their needs and delivering much greater value for them, which leads to improved use and adoption
• Using the for elements for enterprise social tool success (as well as web facing) to better understand where and how to focus understanding gaps and needs for improvement.
• Ways user experience design can be implemented to increase adoption, use, and value
• How social design needs are different from Web 2.0 and what Web 2.0 could improve with this understanding

More info...

For more information and registration to to Viget Lab's Social Design for the Enterprise page.

I look forward to seeing you there.

SharePoint 2007: Gateway Drug to Enterprise Social Tools

Overview

The last couple of years I have had many conversations with a broad selection of mid-sized to large organizations. Some of these are customers of mine or potential customers while others are conversations I have had, but all having the similar discussion about social tools in the enterprise. What follows is a collection of snippets from those conversations regarding Microsoft SharePoint 2007, most are not publicly attributed as they were not intended to be “on the record”.

One common element from all of the discussions is the frustration nearly all of these organization have with their experience with Microsoft SharePoint 2007. The comments are based on those spending one month to a year with the tool (the six month to one year club with tools offer best insight).

SharePoint does some things rather well, but it is not a great tool (or even passable tool) for broad social interaction inside enterprise related to the focus of Enterprise 2.0. SharePoint works well for organization prescribed groups that live in hierarchies and are focussed on strict processes and defined sign-offs. Most organization have a need for a tool that does what SharePoint does well.

This older, prescribed category of enterprise tool needs is where we have been in the past, but this is not where organizations are moving to and trying to get to with Enterprise 2.0 mindsets and tools. The new approach is toward embracing the shift toward horizontal organizations, open sharing, self-organizing groups around subjects that matter to individuals as well as the organization. These new approaches are filling gaps that have long existed and need resolution.

Broad Footprint

What SharePoint 2007 Does Well

Microsoft SharePoint 2007 seems to be in every enterprise I talk to, at least somewhere. It is used if a variety of different ways. When SharePoint is included with addition of Microsoft Office Online (MOSS) is a helpful addition for simple use of these older prescribed methods. MOSS is also good at finalizing documents that are the result of a collective, to group, to collaboration knowledge work process. MOSS and SharePoint are not great at anything but the last step of formalizing the document for distribution in another workflow.

A recent report from AIIM that was written-up by CMS Wire in “Study Finds SharePoint Primarily Used for File Sharing” states “47% use it primarily for file sharing (and/or as an internal Portal 47%)”.

How Did We Get Here?

There is one common point I have heard with nearly every company I have talked with over the last couple years, MS SharePoint 2007 is nearly ubiquitous in deployment. Nearly every organization has deployed SharePoint in some form or another. Many organization have tested it or have only deployed pieces of it. The AIIM survey reported by CMS Wire states: “83% currently use, or planning to use, SharePoint”.

Organizations either sent their IT out for training on SharePoint 2007 and/or brought in consultants to help build an implementation that fit their requirements. Most of the requirements IT departments started with were rather thinly informed, as they have nearly all stated after using SharePoint for a month, most realize after six months or so, their requirements are vastly different than what their initial requirements were, as they have learned more deeply about social tools in the enterprise.

Many who deployed SharePoint, thought it was going to be the bridge that delivered Enterprise 2.0 and a solid platform for social tools in the enterprise is summed up statement, “We went from 5 silos in our organization to hundreds in a month after deploying SharePoint”. They continue, “There is great information being shared and flowing into the system, but we don’t know it exists, nor can we easily share it, nor do much of anything with that information.” I heard this from an organization about 2 years ago in a private meeting and have been hearing near similar statements since. This is completely counter to the Enterprise 2.0 hopes and wishes they had for SharePoint. They were of the mindset that open sharing & having the organization and individuals benefit from a social platform.

MS Marketing’s Promise

The Microsoft marketing people seem to have performed their usual, extend what the product can do to the edges of its capabilities (and occasionally beyond) to map to customer stated desires. In 2006 and 2007 the advent of social computing on the web (Web 2.0) had entered the hormone raging stage gathering attention in boardrooms and IT departments who had been playing around with the ideas of bringing these tools inside the firewall in an official manner. The desire for social software to be part of the enterprise was an interest and desire.

The Microsoft marketing materials they focus on “collaboration and social computing”, which is more of a document management and workflow process tool that they put the more fashionable moniker on. But, it is this Microsoft marketing that engendered many organizations to the idea of the value and promise of social computing inside the firewall and Enterprise 2.0. Microsoft’s marketing legitimized the marketplace, but in typical Microsoft form did not exactly deliver on the promise of marketing.

Part of the promise of SharePoint is a malleable platform, which many developers who work across platforms complain is one of the least malleable and easy to develop on platforms. There are many constraints built into SharePoint and developers for SharePoint are not cheap. Development cycles for SharePoint as said to be about one third to half longer than most other options. At the Enterprise 2.0 Conference this past Summer in Boston, Lockheed Martin had a session demonstrating what they had built on top of SharePoint and it was quite impressive. But when asked about costs and resources, they said: “It took about one year, 40 FTE, and 1 to 5 million U. S. dollars. Very few organizations have those type of resources with availability to take on that task.

What Microsoft marketing did well was sell the value that social tools bring into the enterprise. They put the ideas in the minds of those building requirements (at a minimum to be included in pilot programs) as well as the values derived from using this new generation of social software inside an organization.

Multiple Micro-silos

At various conferences, across many industries, I have spoken at I have been asked to sit in on the SharePoint sessions, which turn into something like group therapy sessions (akin to group therapy in the first Bob Newhart show). There is much frustration and anger being shared as people try to resolve how to share information between groups and easily merge and openly share information once it has been vetted. These groups consistently talk about going directly to their Microsoft support & SharePoint Experts with these problems only to be told it is doable, but far from easy and may break some other things. Finding relevant information or even the inkling that something is happening in some group is nearly impossible. The promise of setting up ad hoc open groups by employees across silos is nearly impossible with out getting authorization.

Information Locked

One of the largest complaints is the information is locked in SharePoint micro-silos and it is nearly impossible to easily reuse that information and share it. Not only is the information difficult to get at by people desiring to collaborate outside the group or across groups, but it is not easily unlocked so that it can benefit from found in search. The Microsoft SharePoint model is one that starts with things locked down (focussed on hierarchies) then opens up, but unlocking is nowhere near as easy a task as it should be.

SharePoint Roadmap Marginalized Over Time

Where do people turn that have gone down the SharePoint route? Well most start by adding solid functionality they had thought SharePoint was going to provide or wished it had. SharePoint has acknowledged some of this weaknesses and has embraced outside vendors that make far superior products to plugin as components.

Some common social tool plug-ins to SharePoint are Socialtext, Atlassian Confluence, and Connectbeam (among with many others). Then there are those who build on top of Sharepoint, like Telligent and News Gator Social Sites. While others are more prone to full platforms that deliver much of the functionality out of the box, like Jive Clearspace.

Plug-ins Extending Functionality to SharePoint

Microsoft makes great promises, or hints at them in its marketing materials for SharePoint along the lines of social software in the enterprise. The first step many organizations take with SharePoint after realizing it does not easily, or even with an abundance of effort, do the expected social software components is to start getting solid proven services and start plugging them in. Many tool makers have taken their great products an made it quite easy to plug them into the SharePoint platform. Want a great wiki tool, not the horrible wiki “template”, then Confluence or Socialtext is added. Need a great social tagging/bookmarking tool that ties into search (this starts enabling finding the good information in SharePoint’s micro-silos), then Connectbeam is added.

This list goes on with what can be plugged-in to Sharepoint to extend it into being something it hints strongly it is quite capable of doing. What one ends up with is a quite capable solution, but built on top of one of the more pricy enterprise platforms. In most cases the cost of all the plug-ins together is less than the cost of SharePoint. It is from this point that many organizations realize all of these add-ins work wonderfully with out SharePoint (however, getting all of them to work together as easy plug-ins to each other is not always easy).

Full-Suites On Top of SharePoint

Another option that organizations take is to move in the direction of putting a fully functional social platform on top of SharePoint. Tools like Telligent and NewsGator Social Sites. These are options for those who find value in what SharePoint offers and does well (but and therefore getting rid of it is not an option), but want ease of development and a lower cost of development than is the norm for SharePoint. These full-suites also provide the ease of not having to deal with working through plugging together various different best of bread solutions (this really reminds me of the path content management systems went down, which was less than optimal).

Not only is the Lockheed Martin example of building on top of SharePoint an example of expense of that platform, but the recent AIIM survey surfaces high cost of development as a rather common understanding:

“Another area of interest is the required effort to customize SharePoint and integration other third-party solutions. In this case, 50% of survey respondents indicated custom solutions required more effort than expected (33% “somewhat more” and 17% “much more”). The integration challenges focused on a lack of training/documentation and integration with non-Microsoft based repositories and existing applications.” From CMS Wire: Study Finds SharePoint Primarily Used for File Sharing.

Fully Replacing SharePoint

There is a third option I have been running into the last year or less, which is removing SharePoint from the organization completely. I know of two extremely large organizations that are removing SharePoint from their organization this year (once these organizations are public with this I can be). The reasoning is cost and under performing as a social platform and what is does well is easily replaced with other solutions as well. In one instance I know the people who brought in SharePoint are being let go as well as the whole team of developers supporting it. I am hearing business operations looking into having their IT department find something that is meets their needs and were promised by IT that SharePoint was that solution. This was echoed by Lee Bryant via Twitter [http://twitter.com/leebryant/status/1099413469]: “[…]problem is many IT depts just don’t care - it is a simple ‘solution’ for them, not their users”

When removing SharePoint some organizations are going the piece by piece approach and stitching together best of breed or are going the route of full-service social platform, like Jive Clearspace. The cost per users of such solutions is less, the time to install to up-and-running fully is reportedly a about a third and maintenance staffing is also reportedly lower.

SharePoint is not Enterprise 2.0

What is clear out of all of this is SharePoint has value, but it is not a viable platform to be considered for when thinking of enterprise 2.0. SharePoint only is viable as a cog of a much larger implementation with higher costs.

It is also very clear Microsoft’s marketing is to be commended for seeding the enterprise world of the value of social software platform in the enterprise and the real value it can bring. Ironically, or maybe true to form, Microsoft’s product does not live up to their marketing, but it has helped to greatly enhance the marketplace for products that actually do live up to the hype and deliver even more value.

LinkedIn: Social Interaction Design Lessons Learned (not to follow) - 2 of 2

This is the second of two posts on the subject, the first post LinkedIn: Social Interaction Design Lessons Learned (not to follow) - 1 or 2 gives the lead-in to this post.

Lessons To Learn

Sadly, the new social functionality has broken much of worked well as an ambient social tool. More problematic was LinkedIn did not seem to grasp what it had: so to build on top of very good start, but it seemingly looked at Facebook for inspiration, but Facebook does not seem to be aware of good social interaction design practices.

When building social tools for broad audiences (more than 3,000 people) — which open services on the web are — there is a progression of 3 things that must be accounted for in the planning stages: 1) Velocity; 2) Volume; 3) Relevance.

As social tools start getting used they go through a progression one of them are these three stages of concern. Velocity of information is how quickly information is added by the community and has turn over on the in the frameworks. Volume is the mass of information that accumulates over time that will force how information is shared, found, and used. Relevance becomes essential when there is large volume and filtering is needed for information flows and for allowing people using the service to have a manageable stream of information that is relevant to their needs.

Many social services can go through these three stages in a few short months if they have 50,000 users or more. LinkedIn does not seem to have considered getting to and beyond the first stage in their planning.

Social Interaction at Scale & Volume

As LinkedIn has added social features they have created more streams of information in their flow. More streams lead to more velocity of information. This can be good if the basic concepts for understanding monitoring these streams as well as providing methods for moving things out of the flow so they can be acted upon or set into a personal task flow.

It seems as if the new social features are aimed at the roughly 80 percent that have 100 or fewer connections, not the moderate or heavy connectors who are the unpaid evangelists that have helped LinkedIn grow. Not understanding the value various segments bring to a service and how to satisfy those groups is rather short sighted

Social Tsunami on Homepage

The one thing that started the frustration with LinkedIn’s shift was the flood of unrelated social items on the homepage. Much of the social content shared is personal ID focused and not group or work focused (even when shared in groups or work related settings - a quick look at activity summaries regularly shows this).

One of the task flows I had with LinkedIn was to accept a connection or get notification of a connection then go to their profile page and download their vCard. The social tsunami that took over the front page of LinkedIn made that task all-but impossible. Part of it is the velocity of information running through the front page for connections increased, velocity the design did not account for.

Additionally, the new social components started eating up valuable real estate on that page and had no simple interaction design convention for minimizing, hiding, or turning off that module of functionality from the page.

Eventually the ability to turn off notifications to the social tools was added to the Settings page, but there is no notification of that functionality on where the problem exists, the pages where this container shows up (we learned this in software design in the early 90s). Also problematic is the social elements are clustered by task/tool relevance and not person or subject. Including pivots could greatly improve this as well as allow for shifting context by the person using LinkedIn.

Focal prioritization is essential to include in initial planning, as this becomes critical when dealing with the relevance stage or even handling a scaling volume of information. Each person using a service is going to have a slightly different set of priorities for relevance and focus. This is going to require some malleability of the system interface to allow for personal optimization of their relevance and streams.

This is not emergent behavior but the reality of what happens when systems scale. LinkedIn is built “;like a classic chamber meeting where networking is orchestrated”;, as stated by Margaret Rosas. Sadly, LinkedIn is not built for flexibility that is needed as systems scale to or beyond the volume stage. It is built as if this was a surprise, which prior to 18 months ago LinkedIn’s careful approach was much smoother with their growth of features and functionality.

LinkedIn changed its layout and structure of its pages to account for the coming new functionality, which is quite smart. But it did so in a manner that seemed to consider all notifications and functionality should have the same focus.

If you remove notifications, there is no ambient notification to let you know there is really any activity. The front page is part portal and part dashboard, but the distinct concepts around these two approaches seem to have baffled the interaction designers and developers.

LinkedIn: Social Node or Social Hub?

LinkedIn also seems quite schizophrenic as to its social purpose. It has built part of the social framework as if the rest of the web only allowed limited interaction with it, which it would make it just a node on a network. This destination framework does not account for people having any other service that provides social features that could easily be shared in or out.

The other side of LinkedIn is a hub, which information flows though. Inbound status messages from other services show up in LinkedIn’s pages as to the “applications”, but using connecting identity in a manner that permits not having Twitter messages I read elsewhere show up in LinkedIn would be more than helpful (yes, part of this is OAuth, which Twitter and many other have not deemed valuable yet (come on Twitter this is not rocket surgery). The applications and information it allows in is limited to a relatively small number of services. Having a small number of services integrated should allow for contextual relevance of the objects, but that would be assuming again LinkedIn was well thought through. This interaction with services would also benefit form LinkedIn offering OpenID as well as OAuth integration to ease the pain and security.

LinkedIn does not have an open API as of yet (this should have happened when they launched status and some other social elements). The LinkedIn API for status would allow LinkedIn to be a sharing out hub as well as the partially capable in-bound hub it already is. LinkedIn is a business focussed social environment, but has not realized its DNA is business based and there are task flows and workflows to enable that would make a lot of sense.

LinkedIn Forgot the “Me” in Social

All social begins with me. Social interaction is about an individuals intentions, actions, and their activities. What things a person wants to share with others and how interact with is one part of the social framework. Another other is consumption and working with the flows of content generated by others. LinkedIn did a decent job with flow until it started adding the more social features in the last 18 months. What LinkedIn did know (focus and purpose) they now show little grasp of understanding as their features have created more flow and more velocity for the information ebbing through the service with no planning for it. It takes very little understanding of social tools to know that this will likely happen and there are interaction elements that are going to be required to handle this, for example moving things out of the flow.

Many people want to see those they have just connected with, things they just published/shared and responses. There is also the desire to hold on to things that are relevant to the individual. This holding on to things requires a means to favorite or put it in place where things can be collected and worked on later. These things could be single comments in group discussions, people’s names/profiles who are surfacing, notifications, etc.

With the velocity of information increasing in LinkedIn the capability to perform a task and drop back into the flow where you were is gone. Any decent interaction designer for social tools knows this reality and had a stack of solutions to set in place from the outset.

Social Context in Groups

The math of social software for people is the mostly the one-to-one relationships and being able to see those. But, social software occasionally is about communicating to groups.

LinkedIn added group discussions, but did this as if the last 10 to 15 years in forums and groupware platforms never existed. The group discussions are not threaded nor do they offer the option to turn on threading for the discussions (this has been default for off-the-shelf forums for over 8 years at least). Also lacking is the capability to hold on to and collect valuable items found in discussions, let alone a means to personally contextualize them.

Another thing LinkedIn fails to grasp is contextual relationships to people in the discussions. For example, if someone I know has started or commented in a group discussion the service should highlight this. There is a potentially higher social contextual relevance for that piece of information. When information starts turning from a stream into a flood this becomes insanely important.

Once this reality of contextualizing is realized, there are a couple of options that are likely to be needed quite quickly after. One is adding new people in the discussion that we interact with; this context could be surfaced in the discussion or used to augment the rational surfaced in the recommendations.

Email from groups should not be from the organization name of the group as that looks like it is from the organization. I get official information from organizations, but lacking the understanding of contextual information for e-mail makes an even greater mess of e-mail and group interactions when this is lazily designed. The “from” should begin with LinkedIn group or some other notation.

Context for Events

When LinkedIn added events, I started getting invitations to attend them. But, the wording of the invites made it sound like they were personal invitations, which is not the context they were intended. It took quite a few rather embarrassing e-mails for many events, if they were really requesting my attendance or if it was just an announcement of the event. Understanding a modicum of social interaction and social etiquette would have saved those embarrassing e-mails.

Events also launched with many bugs (many have been ironed out, but most were of the rather blatant variety). One downside of events is there are already an over abundance of event tools, which work rather well (this is a really tough tool set to get right and build). Nearly everybody I talk to has wondered why LinkedIn did not use something like Confabb to license it or buy it (there are many event services available), rather than using their own resources on something that is not up to the level of competing products. Lastly, with regard to events, while the recommendation for connections is good in LinkedIn, the recommendations for events is absolutely horrid. If that is who LinkedIn thinks I am I need a new service now.

Models for Messaging Flows

One of the things that has been flawed in LinkedIn for quite some time is messaging flows. I liked that they pushed messaging out into e-mail and I could respond to a person from my e-mail. One thing that is missing is LinkedIn not updating their messaging flows. Looking in LinkedIn it is quite often impossible to sort out. When I stated I continually have this problem, Jess Leccetti stated, “I’ve had that exact problem! I thought it was my comp being buggy!” Messaging across various media channels is tough and most often fractured. But, when offering a solution it is important to get it right.

Profile Comments Go In...

Finally LinkedIn added the capability to for people using the service to add their own private comments on to other’s profiles. This is a great addition as it allows the means to add context to files. Sadly, it does not seem to surface that information in any other manner other than going to the individual pages.

This lack of functionality outside each profile page is really mind blowing, as it leaves out the capability for using it for tagging, contextual grouping, search aggregation, and use these aggregations for sharing up dates or filtering what is shared. There are emergent activities that could evolve out of these functionalities, but again this seems to not be well thought through.

One approach is a nice simple personal tagging or labeling interaction layer with clickable aggregation interface option. This would allow simply applying glue to personally thread items together through light aggregation. The current comment system only creates islands of context that have chasms between it and other relevant or related items.

Next Steps

LinkedIn needs to get some people in that grasp social interaction design. They purportedly have some, but I am not sure they have influence or the depth of knowledge needed (either is problematic). The LinkedIn service seems to be proof something is horribly wrong along these lines.

LinkedIn also seems to be a victim of not sorting-out what it wants to be. If it wants to be a Facebook for business, the route they are taking is not going to work well for the business users as it is greatly lacking solid functionality and cohesive interaction design with task flows enabled. LinkedIn needs to be LinkedIn and not a Facebook for business.

As many on Twitter have stated, one seemingly viable option is LinkedIn’s social additions of the last 18 months should all be thrown out and simply start over. The only piece that seems to have much positive feedback is the Q&A section, which is not something that I have interest in, but seems to work passably for others.

More coherently, a real reality check is needed at LinkedIn. They must to stop adding features and functionality until they learn to fix what they have added. They need to begin with understanding how social interaction happens, how it scales, and how people need it to work at scale. Stop looking at Facebook for what features to add. LinkedIn has some deep value as a work and business focussed social site, but that is going to require a different focus that what has been applied in the last year to 18 months.

I have deep fear that LinkedIn views what is happening is emergent (emergence happens when things are used in an unpredictable manner: whether wholly unpredictable or unpredictable in that context). What is happening in LinkedIn is not emergent. It is quite predictable: This is what happens at scale with social systems and their information flows.

A grasp of social systems and their uses at various levels of scale (and potential for various interactions and needs) is really needed at LinkedIn. The slowness to act (or, sadly, react as if this was an unknown potential) and fix what they have is not a great sign of encouragement for the organization. Hopefully having Reid Hoffman back as CEO and with Jeff Wiener as President can pull this into focus and set things on a sane path.

Optimizing Tagging UI for People & Search

Overview/Intro

One of my areas of focus is around social tools in the workplace (enterprise 2.0) is social bookmarking. Sadly, is does not have the reach it should as it and wiki (most enterprise focused wikis have collective voice pages (blogs) included now & enterprise blog tools have collaborative document pages (wikis). I focus a lot of my attention these days on what happens inside the organization’s firewall, as that is where their is incredible untapped potential for these tools to make a huge difference.

One of the things I see on a regular basis is tagging interfaces on a wide variety of social tools, not just in social bookmarking. This is good, but also problematic as it leads to a need for a central tagging repository (more on this in a later piece). It is good as emergent and connective tag terms can be used to link items across tools and services, but that requires consistency and identity (identity is a must for tagging on any platform and it is left out of many tagging instances. This greatly decreases the value of tagging - this is also for another piece). There are differences across tools and services, which leads to problems of use and adoption within tools is tagging user interface (UI).

Multi-term Tag Intro

The multi-term tag is one of the more helpful elements in tagging as it provides the capability to use related terms. These multi-term tags provide depth to understanding when keeping the related tag terms together. But the interfaces for doing this are more complex and confusing than they should be for human, as well as machine consumption.

In the instance illustrated to the tag is comprised or two related terms: social and network. When the tool references the tag, it is looking at both parts as a tag set, which has a distinct meaning. The individual terms can be easily used for searches seeking either of those terms, but knowing the composition of the set, it is relatively easy for the service to offer up "social network" when a person seeks just social or network in a search query.

One common hindrance with social bookmarking adoption is those familiar with it and fans of it for enterprise use point to Delicious, which has a couple huge drawbacks. The compound multi-term tag or disconnected multi-term tags is a deep drawback for most regular potential users (the second is lack of privacy for shared group items). Delicious breaks a basic construct in user focussed design: Tools should embrace human methods of interaction and not humans embracing tech constraints. Delicious is quite popular with those of us malleable in our approach to adopt a technology where we adapt our approach, but that percentage of potential people using the tools is quite thin as a percentage of the population.. Testing this concept takes very little time to prove.

So, what are the options? Glad you asked. But, first a quick additional excursion into why this matters.

Conceptual Models Missing in Social Tool Adoption

One common hinderance for social tool adoption is most people intended to use the tools are missing the conceptual model for what these tools do, the value they offer, and how to personally benefit from these values. There are even change costs involved in moving from a tool that may not work for someone to something that has potential for drastically improved value. The "what it does", "what value it has", and "what situations" are high enough hurdles to cross, but they can be done with some ease by people who have deep knowledge of how to bridge these conceptual model gaps.

What the tools must not do is increase hurdles for adoption by introducing foreign conceptual models into the understanding process. The Delicious model of multi-term tagging adds a very large conceptual barrier for many & it become problematic for even considering adoption. Optimally, Delicious should not be used alone as a means to introduce social bookmarking or tagging.

We must remove the barriers to entry to these powerful offerings as much as we can as designers and developers. We know the value, we know the future, but we need to extend this. It must be done now, as later is too late and these tools will be written off as just as complex and cumbersome as their predecessors.

If you are a buyer of these tools and services, this is you guideline for the minimum of what you should accept. There is much you should not accept. On this front, you need to push back. It is your money you are spending on the products, implementation, and people helping encourage adoption. Not pushing back on what is not acceptable will greatly hinder adoption and increase the costs for more people to ease the change and adoption processes. Both of these costs should not be acceptable to you.

Multi-term Tag UI Options

Compound Terms

I am starting with what we know to be problematic for broad adoption for input. But, compound terms also create problems for search as well as click retrieval. There are two UI interaction patterns that happen with compound multi-term tags. The first is the terms are mashed together as a compound single word, as shown in this example from Delicious.

The problem here is the mashing the string of terms "architecture is politics" into one compound term "architectureispolitics". Outside of Germanic languages this is problematic and the compound term makes a quick scan of the terms by a person far more difficult. But it also complicates search as the terms need to be broken down to even have LIKE SQL search options work optimally. The biggest problem is for humans, as this is not natural in most language contexts. A look at misunderstood URLs makes the point easier to understand (Top Ten Worst URLs)

The second is an emergent model for compound multi-term tags is using a term delimiter. These delimiters are often underlines ( _ ), dots ( . ), or hyphens ( - ). A multi-term tag such as "enterprise search" becomes "enterprise.search", "enterprise_search" and "enterprise-search".

While these help visually they are less than optimal for reading. But, algorithmically this initially looks to be a simple solution, but it becomes more problematic. Some tools and services try to normalize the terms to identify similar and relevant items, which requires a little bit of work. The terms can be separated at their delimiters and used as properly separated terms, but since the systems are compound term centric more often than not the terms are compressed and have similar problems to the other approach.

Another reason this is problematic is term delimiters can often have semantic relevance for tribal differentiation. This first surface terms when talking to social computing researchers using Delicious a few years ago. They pointed out that social.network, social_network, and social-network had quite different communities using the tags and often did not agree on underlying foundations for what the term meant. The people in the various communities self identified and stuck to their tribes use of the term differentiated by delimiter.

The discovery that these variations were not fungible was an eye opener and quickly had me looking at other similar situations. I found this was not a one-off situation, but one with a fair amount of occurrence. When removing the delimiters between the terms the technologies removed the capability of understanding human variance and tribes. This method also breaks recommendation systems badly as well as hindering the capability of augmenting serendipity.

So how do these tribes identify without these markers? Often they use additional tags to identity. The social computing researchers add "social computing", marketing types add "marketing", etc. The tools then use their filtering by co-occurrence of tags to surface relevant information (yes, the ability to use co-occurrence is another tool essential). This additional tag addition help improve the service on the whole with disambiguation.

Disconnected Multi-term Tags

The use of distinct and disconnected term tags is often the intent for space delimited sites like Delicious, but the emergent approach of mashing terms together out of need surfaced. Delicious did not intend to create mashed terms or delimited terms, Joshua Schachter created a great tool and the community adapted it to their needs. Tagging services are not new, as they have been around for more than two decades already, but how they are built, used, and platforms are quite different now. The common web interface for tagging has been single terms as tags with many tags applied to an object. What made folksonomy different from previous tagging was the inclusion of identity and a collective (not collaborative) voice that intelligent semantics can be applied to.

The downside of disconnected terms in tagging is certainty of relevance between the terms, which leads to ambiguity. This discussion has been going on for more than a decade and builds upon semantic understanding in natural language processing. Did the tagger intend for a relationship between social & network or not. Tags out of the context of natural language constructs provide difficulties without some other construct for sense making around them. Additionally, the computational power needed to parse and pair potential relevant pairings is somethings that becomes prohibitive at scale.

Quoted Multi-term Tags

One of the methods that surfaced early in tagging interfaces was the quoted multi-term tags. This takes becomes #&039;research "social network" blog' so that the terms social network are bound together in the tool as one tag. The biggest problem is still on the human input side of things as this is yet again not a natural language construct. Systematically the downside is these break along single terms with quotes in many of the systems that have employed this method.

What begins with a simple helpful prompt...:

Still often can end up breaking as follows (from SlideShare):

Comma Delimited Tags

Non-space delimiters between tags allows for multi-term tags to exist and with relative ease. Well, that is relative ease for those writing Western European languages that commonly use commas as a string separator. This method allows the system to grasp there are multi-term tags and the humans can input the information in a format that may be natural for them. Using natural language constructs helps provide the ability ease of adoption. It also helps provide a solid base for building a synonym repository in and/or around the tagging tools.

While this is not optimal for all people because of variance in language constructs globally, it is a method that works well for a quasi-homogeneous population of people tagging. This also takes out much of the ambiguity computationally for information retrieval, which lowers computational resources needed for discernment.

Text Box Per Tag

Lastly, the option for input is the text box per tag. This allows for multi-term tags in one text box. Using the tab button on the keyboard after entering a tag the person using this interface will jump down to the next empty text box and have the ability to input a term. I first started seeing this a few years ago in tagging interfaces tools developed in Central Europe and Asia. The Yahoo! Bookmarks 2 UI adopted this in a slightly different implementation than I had seen before, but works much the same (it is shown here).

There are many variations of this type of interface surfacing and are having rather good adoption rates with people unfamiliar to tagging. This approach tied to facets has been deployed in Knowledge Plaza by Whatever s/a and works wonderfully.

All of the benefits of comma delimited multi-term tag interfaces apply, but with the added benefit of having this interface work internationally. International usage not only helps build synonym resources but eases language translation as well, which is particularly helpful for capturing international variance on business or emergent terms.

Summary

This content has come from more than four years of research and discussions with people using tools, both inside enterprise and using consumer web tools. As enterprise moves more quickly toward more cost effective tools for capturing and connecting information, they are aware of not only the value of social tools, but tools that get out the way and allow humans to capture, share, and interact in a manner that is as natural as possible with the tools getting smart, not humans having to adopt technology patterns.

Tale of Two Tunnels: Web 2.0 and Enterprise 2.0

Yesterday I made a few comments in Twitter that prompted a fair amount of questions and requests for more information. The quips I made were about the differences between Web 2.0 (yes, an ambiguous term) and Enterprise 2.0 (equally ambiguous term both for the definition of enterprise and the 2.0 bit). My comments were in response to Bruce Stewart's comment The whole "Enterprise 2.0" schtick is wearing thin, unless you've been monitoring real results. Otherwise you're just pumping technology.. In part I agree, but I am really seeing things still are really early in the emergence cycle and there is still much need for understanding of the social tools and the need for them, as well as how they fit in. There are many that are selling the tools as technologies with great promise. We have seen the magic pill continually pitched and bought through out the history of business tools. (For those new to the game or only been paying attention for the last 15 years, a huge hint, THERE IS NO MAGIC PILL).

Tale of 2 Tunnels

One comment I made yesterday is, "the difference between Web 2.0 and Enterprise 2.0 is like the difference building a tunnel through rock and tunnel under water".

That this is getting at is Web 2.0 takes work to build to get through the earth, but once built it can suffer from imperfections and still work well. The tunnel can crack and crumble a little, but still get used with diminished capacity. We can look at Facebook, which has a rather poor interface and still gets used. Twitter is another example of a Web 2.0 solution that has its structural deficiencies and outages, but it still used as well as still loved (their Fail Whale is on a t-shirt now and a badge of pride worn by loyal users).

The Enterprise 2.0 tunnel is built under water. This takes more engineering understanding, but it also requires more fault testing and assurances. A crack or crumbling of a tool inside an organization is not seen kindly and raises doubts around the viability of the tool. The shear volume of users inside an organization using these tools is orders of magnitude less than in the open consumer web world, but faults are more deadly.

The other important factor is perceived fear of the environment. Fewer people (by pure numbers - as the percentages are likely the same, more on this later) are fearful of tunnels through land, they may not have full faith in them, but they know that they will likely make it safely on all of their journeys. The tunnels under water have greater fears as one little crack can cause flooding and drowning quickly. Fears of use of social tools inside an organization is often quite similar, there may be many that are not fearful, but if you spend time talking to people in organizations not using tools (it is the majority at this point) they are fearful of open sharing as that could lead to trouble. People are not comfortable with the concept as they are foreign to it as they are lacking the conceptual models to let them think through it.

Enterprise 2.0 is not Web 2.0

Another statement yesterday that garnered a lot of feedback was, "Web 2.0 does not work well in enterprise, but the approaches and understandings of Web 2.0 modified for enterprise work really well." The web is not enterprise or smaller organizations for that matter. The open consumer web has different scale and needs than inside organizations and through their firewalls. A small percentage of people using the web can get an account on a tool have have appear to be wildly successful correctly claiming 70 million or 100 million people are or have used their tool. But, even 100 million people is a small percentage of people using the web. Looking at real usage and needs for those tools the numbers are really smaller. Most darlings of the Web 2.0 phase have fewer than 10 million users, which is about 5% of the open consumer web users in the United States. On the web a start-up is seen as successful with 500,000 users after a year or two and is likely to have the capability to be self sufficient at that level too. Granted there are many players in the same market niches on the web and the overall usage for link sharing and recommending for Digg, Mixx, or Reddit is much higher across the sum of these tools than in just one of these tools (obviously).

These percentages of adoption and use inside organizations can make executives nervous that their money is not reaching as many employees as they wish. The percentages that can be similar to the web's percentages of high single digit adoption rates to the teens is seen as something that really needs more thinking and consideration.

Enterprise 2.0 is more than just tools (see my Enterprise Social Tools: Components for Success for better understanding) as it also includes interface/interaction design for ease of use, sociality, and encouragement of use. The two biggest factors that are needed inside an organization that can receive less attention on the web are the sociality and encouragement of use.

Understanding sociality is incredibly important inside an organization as people are used to working in groups (often vertical in their hierarchy) that have been dictated to them for use. When the walls are broken down and people are self-finding others with similar interests and working horizontally and diagonally connecting and sharing with others and consuming the collective flows of information their comfortable walls of understanding are gone. A presentation in Copenhagen at Reboot on Freely Seeping Through the Walls of the Garden focussed just on this issue. This fear inside the enterprise is real. Much of the fear is driven by lacking conceptual models and understanding the value they will derive from using the tools and services. People need to know who the other people are that they are sharing with and what their motivations are (to some degree) before they have comfort in sharing themselves.

Encouraging use is also central to increased adoption inside organizations. Many organizations initial believe that Web 2.0 tools will take off and have great adoption inside an organization. But, this is not a "build it and they will come" scenario, even for the younger workers who are believed to love these tools and services and will not stay in a company that does not have them. The reality is the tools need selling their use, value derived from them, the conceptual models around what they do, and easing fears. Adoption rates grow far beyond the teen percentages in organizations that take time guiding people about the use of the tools and services. Those organizations that take the opportunity to continually sell the value and use for these tools they have in place get much higher adoption and continued engagement with the tools than those who do nothing and see what happens.

Gaps in Enterprise Tools

The last related statement was around the gaps in current and traditional enterprise tools. At the fantastic Jive Enterprise UI Summit in Aspen a few weeks ago there was a lot of discussion about enterprise tools, their UI, and ease of use for employees by the incredible collection of people at the event. One of the things that was shown was a killer path of use through a wide encompassing enterprise toolset that was well designed and presented by SAP's Dan Rosenberg who has done an incredible job of putting user experience and thinking through the needed workflows and uses of enterprise tools at the forefront of enterprise software planning. Given the excellent design and incredible amount of user experience thought that went into the tools behind the SAP toolset in the scenario (one of the best I have seen - functioning or blue sky demoed) there are still gaps. Part of this is identifying of gaps comes from traditional business thinking around formal processes and the tools ensure process adherence. But, the reality is the tools are quite often inflexible (I am not talking about SAP tools, but traditional enterprise tools in general), the cost of time and effort is beyond the gain for individuals to document and annotate all decisions and steps along the way. The hurdles to capture information and share it are often too large for capturing one to 10 quick sentences of information that can be retained for one's own benefit or shared with other where it is relevant.

There is another gap in business around the collective intelligence that is needed, which can lead to collaboration. Most businesses and their tools focus on collaboration and set groups, but at the same time wonder why they do not know what their company knows and knowledge is not all being captured. First there is a difference between collective and collaborative activities and the tools and design around and for those different activities is more than a nuance of semantics it is a huge barrier to capturing, sharing, and learning from information that leads to knowledge if it is not understood well. Enterprise has gone through its phases of knowledge management tools, from forms for capturing information, forums for sharing, and up to enterprise content management systems (ECM) that encompass document management, content management, knowledge management, and information harvesting. But, the gaps still exist.

These existing gaps are around conversations not being captured (the walls of the halls have no memory (well today they do not)) and increasingly the ubiquitous communication channel in organizations, e-mail, is being worked around. Quick decisions are not being documented as it is not enough for a document or worth completing a form. As the iterative processes of development, design, and solution engineering are happening at quicker and smaller increments the intelligence behind the decisions is not being captured or shared. This is largely because of the tools.

As has always been the case large enterprise systems are worked around through the use of smaller and more nimble solutions that augment the existing tools. Even in Dan's incredible demo I saw gaps for these tools. The quick tools that can fill these gaps are blogs, wikis, social bookmarking, tagging, Twitter type sharing, Veodia type video sharing, instant messaging, etc. There are many avenues to quickly capture information and understanding and share it. These tools get out of the way and allow what is in someone's head to get digitized and later structured by the individual themselves or other people whom have had the information shared with them in a community space. This turns into flows through streams that can be put into many contexts and needs as well as reused as needed.

Another point Dan stated at the Enterprise UI Summit that is dead on, is organizations are moving out of the vertical structures and moving to the horizontal. This is having a profound effect on the next generation of business tools and processes. This is also an area for Enterprise 2.0 tools as they easily open up the horizontal and diagonal prospects and tie into it the capability for easily understanding who these newly found people are in an organization through looking at their profiles, which eases their fears around sharing and unfamiliar environments as well as their related tasks.

"Building the social web" full-day workshop in Copenhagen on June 30th

Through the wonderful cosponsoring of FatDUX I am going to be putting on a full-day workshop Building the Social Web on June 30th in Copenhagen, Denmark (the event is actually in Osterbro). This is the Monday following Reboot, where I will be presenting.

I am excited about the workshop as it will be including much of my work from the past nine months on setting social foundations for successful services, both on the web and inside organizations on the intranet. The workshop will help those who are considering, planning, or already working on social sites to improve the success of the services by providing frameworks that help evaluating and guiding the social interactions on the services.

Space is limited for this workshop to 15 seats and after its announcement yesterday there are only 10 seats left as of this moment.

Speaking at the International Forum on Enterprise 2.0 Near Milan, Italy

Under a month from now I have the wonderful pleasure of speaking at the International Forum on Enterprise 2.0, this is just outside of Milan in Varese, Italy on June 25, 2008. I am really looking forward to this event as there are many people whom I chat with on Skype with and chat with in other ways about enterprise and the use of social tools inside these organizations. It is a wonderful opportunity to meet them in person and to listen to them live as they present. Already I know many people attending the event from the United Kingdom, Switzerland, Germany, Austria, Spain, and (of course) Italy. If you are in Europe and have interest this should be a great event to get a good overview and talk with others with interest and experience. Oh, did I mention the conference is FREE?

I will be presenting an overview on social bookmarking and folksonomy and the values that come out of these tools, but also the understanding needed to make good early decisions about the way forward.