REAP and its kissin' cousin memes

When it comes to posts that go at “Beyond Search is ___”, one has a good chance in the blogosphere, of, well, being mostly ignored … By now, you can more or less be overloaded just by search results for Simon “Poverty of Attention”. Hence my threshold, following my first post on REAP remains high, but this doesn’t by itself prevent some flights of fancy. Think of it as a meme tasting party of some memes that have reached their time

First up is Sensemaking, originating in the foothills of Palo Alto, and as noted, my all time fav for naming the human process itself. It scales to the biggest questions that make us humans, and anthropologists and philosophers alike have been there at increasing levels of abstraction. Mark Stefik, serial sensemaker extraordinaire, commented on the first REAP post, and has a nice expository piece. Sensemaking has been a long running rubric and effort at PARC (which I was part of once). Mark raises substantive questions in his comments, which I’ll leave for later, but I’ll make one point worth underlining.

Though like Sensemaking, REAP as a whole suggests a human objective: we strive to get value from stuff and activities, it’s real emphasis is meant to be on the middle concepts that cover many particular acts that can be effectively augmented with tools. Like Retrieval, the broad areas of Extract, Arrange, and Present have proven stable and coherent in characterizing useful processing and observable outputs that work well in many different domains. Let me further illustrate with examples of REAP function that can be useful in full REAP systems.

• Extract — pulling feature or attributes out. Good examples include isolating distinctive concepts; identifying people, places, and things mentioned; and pulling key sentences out. This phase could easily be called Analyze from the processing perspective but Extract is more particular and more clearly indicate the small beneficial bits coming out (ala tired to my ears, “golden nuggets”).

• Arrange — putting things into structures. Good examples here include grouping documents with or without names for the groups (e.g. piles or folders); assembling bits into other conceptual structures including lists, hierarchies, networks; and assigning/discovering types, categories, or schemas. Organize would be another great word here, and one I’d happily use except for you know why.

• Present — preparing artifacts for human consumption. Examples here are visual layouts including graphs, charts, documents of all sorts, and interactive visualizations including Wide Widgets of the See and Go kind. Here the word may be struggling a bit, but in the end I think it almost reaches what it needs to reach. There is no presentation without a purpose and audience, and each of these may be broad or narrow, one or many. The reach it doesn’t quite have is covered by whispering “personalize.”

We’re into several gulps by now, so let’s move along. Next up is the concept of “Information Supply” which Andrei Broder and friends have been pursuing (this afternoon, in fact) or the more colloquial “search without a box.” Considering an interview, a set of slides, and fading memories of a conversation, I see the key point is that information can be supplied based on intent to the point of use. This is about intelligent attachment with all the required delicacy. No query in, refined results out. Definitely a good idea.

Twisting on this but not twisting away or far, I’ll comment you needn’t kill the box. It’s not just “search without a box” but also “a box without a page.” Words like ubiquitous, pervasive, and embedded fit right in, to get at the everywhere and inbetween-ness wanted. For obvious economic and less-obvious human reasons explained by bounded rationality, there is a great deal of focus on the uber-start-page of search, but the search box should come to us too. Asking in a context should help a lot. It’s a short term aberration that it is easier to google (shall we take the verb :-) then to use Windows help or man in a Unix shell.

Now let’s go on to the final taste, with the buzz on from the two deeper darks, we’re now into party time bubbles, which make people say things like “cool, but it’s Friggin’ USEless.” Yep, talkin’ about the Y generation, and FUSE. Find Use Share Expand. Battelle, a true sense-talker, spoke sense last year and in Y! actions since, it does seem to be mostly about leveraging the social. I like this one a lot, and it nicely captures the broader sense of experiences we share together on the Internet together. And there is something, well, just expansive about that last verb.

The party’s gone too far, if we get into fussy air over four-letter apronyms. A few thoughts effervesce from the top of mind. The major difference of emphasis is consumer vs. professional, a distinction that does and doesn’t matter, but otherwise there’s plenty of shared blood. Both FUSE and REAP say there’s more to life than finding. Second, the little machine acts of EAP-ing are again the next level down of the Use phase, and probably also in Sharing and Expanding depending on exact definitions. And finally, data from the Social is clearly a big opportunity within the EAP processing itself.

So looking back at the tasting notes: Bring on the sensemaking! Bring the information supply line to where we are. And yo, you’ve got FUSE in my REAP, and I’ve got REAP in your FUSE.

Vox for the private, personal, and playful

Over the years of toyful blogging, I’ve resisted splitting the flow of this blog into separate blogs for the “personal”, other, and off-topic. Certainly, there has never been much more than a trickle to split, but it was also a sense that a percentage personal was an intrinsic and a goodness in this genre of conversational writing. However, it’s clear you shouldn’t let the air to fuel ratio get out of whack. Recently there’s been a knocking to the personal here, not suprisingly, given my recent combustions.

Never thought of myself, as exactly headed toward MySpace or LiveJournal, but in a fashion, perhaps the time has come for something like that. During this transition, a series of fortunate events, now see me with another blog, that hardly anybody can see, but it may yet poke out above waterline.

• I found myself writing, talking about what was up to many different people—friends, family, reconnected colleagues, new people fast becoming new friends. Lots of emails, fair amount of IM-ing telling bits and pieces of the story over and over, even as it was developing, eventually a notification email notifying hundreds in my address book … and so of course, this led to thoughts of how best to communicate about not just the personal, but in the full range of widely and narrowly, of openly and privately.

• I listened to a podcast capture of Anil Dash’s MeshForum talk in which he shares many observations from the LiveJournal experience. Much of what Anil observed about the contrast between the professional blogging of Typepad users and the social blogging of LiveJournal users really rang true to me … and was timely.

• Not long after, I got my requested invitation to the Vox preview, and in August I started an experiment by inviting a small set of my longest, close friends, all that go back before there was any professional or career to me. Almost all registered to read what I was writing, but none have posted. I started postings about family, a remodel, sharing the experience of the “squeezing through a straw” of this period. So far, mostly the kind of stuff that many people write in those annual letters they enclose in their holiday greeting cards, nothing deeply revealing, but tending toward the private.

Now I’m beginning to think that my Vox blog, though now all private, may indeed perhaps pull the mostly personal across and also create a space for the comfortably-shared off-topic and playful. Vox is now launched, and certainly, Mena and Ben are proud as they explain the vision of Vox. And David Hornik, is also proud as Sixapart funder and one who really does the professional/personal wavicle split blogging thing quite well.

And they all ought be proud. I’ll certainly raise my big thumbs-up to the long line of impressed. For the moment, I’ll just add two main points of feedback:

• Given the large ratio of readers to writers (even in this space of personal), private friends should be able to read my entry w/o registering. The Open Identity systems like in fact the OpenID system that has come out of the Sixapart people itself could/should be just the right mechanism for this. (Note a commenter on David Hornik’s post also makes this point.)

• I’m personally already wishing for a bit more control over privacy levels. Right now, you can post for family, friends, both, or public. And though the design point of Vox really demands absolute simplicity and it’d be to easy to suck here, the current switches feel big to me. Though it may take a few years for a signal from a broad and full user base, I wouldn’t be surprised to see it come quickly, given the great nuance most people do have on levels of how open or closed they are in different settings. With all the complaints about Email, many little things do work with it quite well, including the quite powerful and simple mechanism of allowing you to choose exactly the To, CC, and subtle BCC.

Beyond Search is REAP

… I’m sure I’m repeating myself and plenty of others by now, but it’s time to resurface “the vision” of Information Flow. It’s easy with long days and a real and full life with varied encounters with strangers, friends, and family to fall back on the crutch of calling what I do, “Beyond Search stuff.” But here in my open conversations with you it’s time to remint the concept, especially in the fresh dirt as the sprout of a new company labors to push its head out.

Beyond Search is not the same thing as Search getting better. Search can get better. Boy, can it?! However, Beyond Search is something else. Not just the litany of algorithms and technologies i.e. linguistics, statistics, extraction, categorization, clustering, personalization, visualization, social this that and the other. There is a holistically different experience to be had! And it will be at least as valuable as Search to some people, and that some is a huge many. It’s everybody that has a long term stake in subject matters and that utilizes such knowledge to get things done in the world. It’s poets, priests and politicians; it’s lawyers, doctors, and professors; journalist, analysts, and researchers; and it’s business professionals, financiers, and even thoroughbred horse rearers.

At PARC as we saw a future shift from document creation to information access coming, we, speaking Academicese called it Intelligent Information Access. And at Inxight, in Marketingese, we called it Discovery. And in the idiolect (and that doesn’t mean a language spoken by an idiot) of Ramanese, it’s the difference between “Users Chasing Documents,” and Information Flow enabled by “Statistics over Statements.” How we utilize information available over the Internet in professional activities is still fundamentally challenged. I think everybody can tell their own version of the story.

In throwaway lines, I’ve said to many, “you could called our new venture, a Vertical Search play, but it ain’t vertical, and it ain’t search.” That line is a disservice in its aint-i-ness, because things worth doing should be expressed in the positive (hmm, maybe). Now, the drum roll … we are building a REAP system (now you got it, huh?), but REAP is much bigger than us, much, and so I’m going to start talking about the bigger.

Beyond Search is REAP. REAP acro-expands into Retrieve, Extract, Arrange, Present. And REAP systems help people support that full process using those technologies mentioned above. Certainly, any of these verbs can be picked on, and many alternatives like Collect, Analyze, Organize, Keep, Share, hey even Remix, so fly to mind. But in aggregate, the point without niggling, is that we’re still not there with the deeper tools and the whole experience we desire for truly reaping the value from all that’s available to us on the Internet. Consider the typical information work flow of a professional:

• Retrieve — collect information from a variety of sources
• Extract — extract data, facts, examples
• Arrange — arrange documents and facts for use now or later
• Present — compose information into artifacts of value

Search is just about the retrieve and the -eaping is pretty much left to the person. Does knowledge worker come to mind? My all time favorite word for the human process (hat tip of fifteen years back to friends Dan Russell and Mark Stefik) is sensemaking because it reaches to even the deepest levels and the broadest extent of what we are after. Some of my friends, especially these two—actually pretty much all of my friends and yours too—are incredible sensemaking machines.

We all use the aggregate of tools and means at our disposal to make sense of subjects and the world and to guide our actions. However, I’m sensing a widespread frustration with a great deal of wasteful manual labor as we die, gently reaping. And though I am a huge believer that doing things by hand often gives you a depth of understanding, there’s a lot I don’t do because of the effort required. The difference between productivity and new capability isn’t always in kind, but often in degree. If you can take many more steps, you arrive at places you’d never get. And I’ll continue to invest my time on the bet that huge social opportunity lies ahead in making us all smarter by mainstreaming REAP systems.

Speak up, come along …